00000001:02000400:3.0F:1787599105.181381:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787599124.037917:0:3175:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787599126.103409:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 466 MB/s 00000001:01000000:1.0:1787599126.363133:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 555 MB/s 00000001:01000000:2.0F:1787599126.612349:0:3238:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2479 MB/s 00000020:02000000:1.0:1787599127.386111:0:3268:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g20f51fc 00000400:02000000:2.0:1787599128.318119:0:3283:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.130@tcp [8/256/0/180] 00008000:02000000:3.0:1787599132.048034:0:3432:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787599182.292649:0:5232:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787599191.959751:0:5812:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787599191.959756:0:5812:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787599191.959959:0:5812:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000474d0f98 00000080:02000400:2.0:1787599191.959970:0:5812:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787599191.966826:0:5812:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787599191.966900:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0F:1787599191.967034:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001af93791) 00000020:00000080:0.0:1787599191.967060:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787599191.988607:0:5812:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787599191.989079:0:5812:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787599192.040887:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787599192.040921:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787599192.040940:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787599192.041006:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787599192.041032:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787599192.041379:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787599192.041386:0:5812:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787599192.041396:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc6741182279 00000020:01000004:0.0:1787599192.041403:0:5812:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787599192.041409:0:5812:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787599192.041413:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000474d0f98 from MGS 00000020:01000004:0.0:1787599192.041417:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787599192.041426:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000734a56e8) 00000020:00000080:0.0:1787599192.041436:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787599192.041506:0:5812:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000474d0f98 from MGS, refs=2 00080000:01000000:0.0:1787599192.041513:0:5812:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787599192.041518:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc6741182287 00000100:00100000:0.0:1787599192.041615:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787599192.041731:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787599192.041736:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787599192.048020:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787599192.048038:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787599192.049276:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599192.049647:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787599192.049653:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787599192.051066:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787599192.051075:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787599192.051711:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787599192.051719:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787599192.053023:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599192.053028:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599192.053029:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599192.053658:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599192.053661:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599192.053662:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599192.055127:0:5812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787599192.059520:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787599192.304712:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2055 MB/s 00000001:01000000:3.0:1787599192.554788:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2195 MB/s 00000001:01000000:3.0:1787599192.805607:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 677 MB/s 00000001:01000000:0.0:1787599193.055461:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 759 MB/s 00010000:00010000:3.0:1787599193.057856:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1787599193.063109:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787599193.084470:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787599193.084486:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787599193.084489:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787599193.090805:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787599193.091228:0:5812:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787599193.091306:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787599193.091573:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787599193.091599:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787599193.092289:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599193.092453:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787599193.092459:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787599193.105674:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787599193.105687:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787599193.106606:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787599193.106614:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787599193.107041:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787599193.107060:0:5812:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.130@tcp' 00000020:01000004:0.0:1787599193.107062:0:5812:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787599193.107106:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.130@tcp (typ=mgc) 00000020:00000080:0.0:1787599193.107117:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.130@tcp (00000000f3454f2b) 00000020:00000080:0.0:1787599193.107132:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787599193.107839:0:5812:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dec80709@MGC192.168.204.130@tcp: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1787599193.108009:0:5812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.130@tcp-0 is initialized 00000040:01000000:0.0:1787599193.108016:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787599193.115038:0:5828:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:2.0:1787599193.115408:0:5827:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787599193.115485:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.130@tcp (uuid a65f327d-6cf7-4b01-bb9d-92abd32dc6c7) 00000020:00000080:0.0:1787599193.115505:0:5812:0:(genops.c:1385:class_connect()) connect: client a65f327d-6cf7-4b01-bb9d-92abd32dc6c7, cookie 0xa46cbc6741182295 00000100:00080000:0.0:1787599193.115515:0:5812:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787599193.115520:0:5812:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import 00000000dec80709 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787599193.115558:0:5812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b4db5632 x1874433543241856/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787599193.115586:0:5812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS 00000020:01000004:0.0:1787599193.115606:0:5812:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787599193.115610:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787599193.115622:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000e2f8001) 00000020:00000080:0.0:1787599193.115633:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787599193.116505:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4db5632 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3298:1874433543241856:0@lo:250: 00000100:00100000:2.0:1787599193.116766:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599193.129816:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543241856 00000100:00100000:2.0:1787599193.129831:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543241856 00000100:00100000:2.0:1787599193.129898:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599193.129906:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ff26948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3298:x1874433543241856:12345-0@lo:250: 00010000:00080000:2.0:1787599193.129934:0:5825:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a65f327d-6cf7-4b01-bb9d-92abd32dc6c7@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:2.0:1787599193.129977:0:5825:0:(genops.c:1385:class_connect()) connect: client a65f327d-6cf7-4b01-bb9d-92abd32dc6c7, cookie 0xa46cbc67411822a3 00000100:00080000:2.0:1787599193.130109:0:5825:0:(import.c:65:import_set_state_nolock()) 00000000bf45f92e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599193.136113:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ff26948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:3298:x1874433543241856:12345-0@lo:250: Request processed in 6195us (19337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599193.136131:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599193.136231:0:3298:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787599193.136252:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.130@tcp: connect to target with instance 0 00000100:00080000:2.0:1787599193.136260:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787599193.136266:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787599193.136269:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000dec80709 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787599193.136273:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787599193.136281:0:3298:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787599193.136288:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4db5632 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3298:1874433543241856:0@lo:250: 00000100:00100000:2.0:1787599193.142109:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599193.142346:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787599193.142352:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787599193.143072:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787599193.143080:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787599193.144578:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787599193.144587:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787599193.153231:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599193.153418:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787599193.153425:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787599193.156597:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787599193.156611:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787599193.215098:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599193.216451:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787599193.216460:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787599193.220986:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787599193.221011:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787599193.221793:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599193.221983:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787599193.221989:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787599193.223414:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787599193.223426:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787599193.225355:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599193.225588:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787599193.225594:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787599193.226147:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787599193.226153:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787599193.226925:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599193.227094:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787599193.227099:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787599193.234276:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787599193.234295:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787599193.283568:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599193.283786:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787599193.283793:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787599193.289659:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599193.289681:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787599193.293318:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787599193.293333:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787599193.294609:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787599193.294632:0:5812:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787599193.294638:0:5812:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787599193.294781:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787599193.294810:0:5812:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787599193.294814:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787599193.294816:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787599193.294817:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599193.294818:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599193.294819:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599193.294821:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599193.294822:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599193.294823:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787599193.294825:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599193.294826:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599193.294828:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599193.294829:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787599193.294832:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787599193.294834:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599193.294836:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787599193.294837:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599193.294838:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599193.294839:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599193.294840:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599193.294841:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599193.294842:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787599193.294843:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599193.294844:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599193.294844:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599193.294845:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787599193.294881:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787599193.294897:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b23d439c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543241984:0@lo:253: 00000100:00100000:3.0:1787599193.294983:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599193.295030:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039e42f8b going to sleep for 11 seconds 00000100:00100000:2.0:1787599193.295179:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543241984 00000100:00100000:2.0:1787599193.295187:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543241984 00000100:00100000:2.0:1787599193.295229:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599193.295237:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007721674 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:5812:x1874433543241984:12345-0@lo:253: 20000000:01000000:2.0:1787599193.295277:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787599193.295280:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787599193.298776:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787599193.298841:0:5826:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787599193.299140:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599193.300138:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787599193.308739:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787599193.308748:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787599193.308755:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787599193.308758:0:5826:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787599193.308770:0:5826:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787599193.309039:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599193.309398:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787599193.309410:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787599193.309449:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787599193.309486:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787599193.309514:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787599193.309589:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787599193.309596:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787599193.309630:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787599193.309637:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787599193.309660:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787599193.309665:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787599193.309687:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787599193.309724:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787599193.309749:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787599193.309753:0:5826:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787599193.309762:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599193.309921:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787599193.309930:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787599193.309974:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787599193.310008:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787599193.310049:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787599193.310059:0:5826:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787599193.310125:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787599193.310133:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787599193.311396:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787599193.311442:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787599193.311479:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787599193.311491:0:5826:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787599193.311595:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787599193.311605:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787599193.311636:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787599193.311667:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787599193.311845:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787599193.311890:0:5826:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787599193.311898:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787599193.314449:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787599193.319414:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787599193.319449:0:5826:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.130@tcp for mdt 20000000:01000000:2.0:1787599193.319453:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:2.0:1787599193.319489:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787599193.319497:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787599193.319528:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787599193.319536:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:2.0:1787599193.319604:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787599193.319616:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787599193.319649:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787599193.319683:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787599193.319747:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787599193.319750:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787599193.319754:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787599193.319765:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787599193.319768:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787599193.319799:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787599193.319801:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787599193.320436:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787599193.320676:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787599193.320717:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787599193.320798:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787599193.320814:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787599193.320817:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787599193.323552:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787599193.323914:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787599193.323974:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787599193.324007:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787599193.324020:0:5826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599193.324022:0:5826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787599193.324028:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787599193.324030:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787599193.324036:0:5826:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787599193.324042:0:5826:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787599193.330603:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787599193.335342:0:5826:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787599193.347755:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787599193.347801:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787599193.347865:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787599193.347883:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787599193.347901:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.347918:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.347940:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.347962:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.347969:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.347975:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.347982:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000f263fde already unused, calling callback (00000000a08c7468) 00010000:00010000:2.0:1787599193.347985:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.347992:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.348004:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.348010:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.348016:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000f263fde/0xa46cbc67411822aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787599193.348032:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787599193.759893:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007721674 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:5812:x1874433543241984:12345-0@lo:253: Request processed in 464648us (464901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599193.759924:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599193.760046:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b23d439c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543241984:0@lo:253: 10000000:01000000:3.0:1787599193.760063:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787599193.760066:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599193.760068:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787599193.760069:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599193.760070:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787599193.760071:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599193.760073:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599193.760074:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599193.760075:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787599193.760077:0:5812:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787599193.760078:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599193.760080:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787599193.760099:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000474d0f98 from lustre-MDT0000 10000000:01000000:3.0:1787599193.760125:0:5812:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787599193.760128:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787599193.760132:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f6c50f78000 10000000:01000000:3.0:1787599193.760137:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787599193.760145:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f6c50f78000 from 1 10000000:01000000:3.0:1787599193.760147:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787599193.760222:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000cff042cc/0xa46cbc67411822b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599193.760244:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000cff042cc/0xa46cbc67411822b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599193.760253:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000cff042cc/0xa46cbc67411822b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599193.760271:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b23d439c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242112:0@lo:101: 00000100:00100000:3.0:1787599193.760308:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599193.760358:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000003edd09dc going to sleep for 11 seconds 00000100:00100000:2.0:1787599193.760483:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543242112 00000100:00100000:2.0:1787599193.760490:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543242112 00000100:00100000:2.0:1787599193.760526:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599193.760534:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d15c0bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:5812:x1874433543242112:12345-0@lo:101: 00010000:00010000:2.0:1787599193.760546:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599193.760558:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f263fde/0xa46cbc67411822b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411822b1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.760579:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f263fde/0xa46cbc67411822b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411822b1 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.760588:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f263fde/0xa46cbc67411822b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411822b1 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.760597:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f263fde, rc 0) 00000100:00100000:2.0:1787599193.760634:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d15c0bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+6:5812:x1874433543242112:12345-0@lo:101: Request processed in 101us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599193.760641:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599193.760710:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b23d439c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242112:0@lo:101: 00010000:00010000:3.0:1787599193.760723:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000cff042cc/0xa46cbc67411822b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599193.760731:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000cff042cc/0xa46cbc67411822b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599193.760788:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b23d439c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242240:0@lo:501: 00000100:00100000:3.0:1787599193.760810:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599193.760860:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000003edd09dc going to sleep for 11 seconds 00000100:00100000:2.0:1787599193.767729:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543242240 00000100:00100000:2.0:1787599193.767744:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543242240 00000100:00100000:2.0:1787599193.767800:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599193.767809:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8549d7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+6:5812:x1874433543242240:12345-0@lo:501: 00000100:00100000:2.0:1787599193.768110:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8549d7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+6:5812:x1874433543242240:12345-0@lo:501: Request processed in 302us (7298us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787599193.768119:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599193.770051:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b23d439c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242240:0@lo:501: 10000000:01000000:2.0:1787599193.770110:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787599193.770133:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000cff042cc/0xa46cbc67411822b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.770143:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000cff042cc/0xa46cbc67411822b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599193.770152:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f6c6dd51000 10000000:01000000:2.0:1787599193.770180:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787599193.770185:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f6c6dd51000 10000000:01000000:2.0:1787599193.770187:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787599193.770191:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f6c6dd51000 from 1 10000000:01000000:2.0:1787599193.770194:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787599193.770301:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000603e038b/0xa46cbc67411822bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.770309:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000603e038b/0xa46cbc67411822bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.770319:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000603e038b/0xa46cbc67411822bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599193.770337:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e6899b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242368:0@lo:101: 00000100:00100000:2.0:1787599193.770391:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599193.770478:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c10363e going to sleep for 11 seconds 00000100:00100000:1.0:1787599193.773329:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543242368 00000100:00100000:1.0:1787599193.773347:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543242368 00000100:00100000:1.0:1787599193.773491:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599193.773501:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090813f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+6:5812:x1874433543242368:12345-0@lo:101: 00010000:00010000:1.0:1787599193.773519:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599193.773539:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009672d138/0xa46cbc67411822c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411822bf expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599193.773565:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009672d138/0xa46cbc67411822c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411822bf expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599193.773575:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009672d138/0xa46cbc67411822c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411822bf expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599193.773583:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009672d138, rc 0) 00000100:00100000:1.0:1787599193.773669:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090813f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+7:5812:x1874433543242368:12345-0@lo:101: Request processed in 170us (3278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599193.773675:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599193.773776:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e6899b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242368:0@lo:101: 00010000:00010000:2.0:1787599193.773793:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000603e038b/0xa46cbc67411822bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.773812:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000603e038b/0xa46cbc67411822bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599193.773830:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787599193.773852:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000603e038b/0xa46cbc67411822bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.773859:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000603e038b/0xa46cbc67411822bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599193.773866:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787599193.773870:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599193.773875:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f6c6dd51000 10000000:01000000:2.0:1787599193.773877:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787599193.773881:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787599193.773884:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787599193.773905:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000ed86ff4d/0xa46cbc67411822cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.773912:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000ed86ff4d/0xa46cbc67411822cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.773919:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000ed86ff4d/0xa46cbc67411822cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599193.773950:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e6899b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242496:0@lo:101: 00000100:00100000:2.0:1787599193.773985:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599193.778109:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c10363e going to sleep for 11 seconds 00000100:00100000:0.0:1787599193.779327:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543242496 00000100:00100000:0.0:1787599193.779339:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543242496 00000100:00100000:2.0:1787599193.780420:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599193.780429:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce640c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+7:5812:x1874433543242496:12345-0@lo:101: 00010000:00010000:2.0:1787599193.780447:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599193.780463:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c027f7bc/0xa46cbc67411822d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411822cd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.780487:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c027f7bc/0xa46cbc67411822d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411822cd expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.780497:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c027f7bc/0xa46cbc67411822d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411822cd expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599193.780506:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c027f7bc, rc 0) 00000100:00100000:2.0:1787599193.780577:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce640c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+8:5812:x1874433543242496:12345-0@lo:101: Request processed in 149us (6591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599193.780584:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599193.781300:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e6899b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242496:0@lo:101: 00010000:00010000:0.0:1787599193.781317:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000ed86ff4d/0xa46cbc67411822cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599193.781326:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000ed86ff4d/0xa46cbc67411822cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599193.781385:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c748d3f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242624:0@lo:501: 00000100:00100000:0.0:1787599193.781438:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599193.781466:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1b5c25a going to sleep for 11 seconds 00000100:00100000:2.0:1787599193.781559:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543242624 00000100:00100000:2.0:1787599193.781564:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543242624 00000100:00100000:2.0:1787599193.781584:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599193.781590:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b684f430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+8:5812:x1874433543242624:12345-0@lo:501: 00000100:00100000:2.0:1787599193.781814:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b684f430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+9:5812:x1874433543242624:12345-0@lo:501: Request processed in 224us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599193.781821:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599193.782686:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c748d3f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242624:0@lo:501: 00000100:00100000:0.0:1787599193.782733:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c748d3f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242752:0@lo:503: 00000100:00100000:0.0:1787599193.782782:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599193.782815:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1b5c25a going to sleep for 11 seconds 00000100:00100000:2.0:1787599193.782872:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543242752 00000100:00100000:2.0:1787599193.782878:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543242752 00000100:00100000:2.0:1787599193.782908:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599193.782914:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d0b6d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+9:5812:x1874433543242752:12345-0@lo:503: 00000100:00100000:2.0:1787599193.783089:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d0b6d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+9:5812:x1874433543242752:12345-0@lo:503: Request processed in 174us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599193.783102:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599193.783315:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c748d3f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543242752:0@lo:503: 00000100:00100000:0.0:1787599193.783660:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c748d3f1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5854:1874433543242880:0@lo:502: 00000100:00100000:0.0:1787599193.783694:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599193.783721:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f85da6bb going to sleep for 11 seconds 00000100:00100000:2.0:1787599193.783766:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543242880 00000100:00100000:2.0:1787599193.783770:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543242880 00000100:00100000:2.0:1787599193.783797:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787599193.783803:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e278b63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+9:5854:x1874433543242880:12345-0@lo:502: 00000100:00100000:2.0:1787599193.783952:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e278b63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+9:5854:x1874433543242880:12345-0@lo:502: Request processed in 149us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599193.783959:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599193.784056:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c748d3f1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5854:1874433543242880:0@lo:502: 00000020:01000000:0.0:1787599193.784075:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599193.784084:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599193.784086:0:5854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787599193.784091:0:5854:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787599193.784094:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787599193.784112:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002abd99d4) 00000020:00000080:0.0:1787599193.784129:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787599193.784136:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787599193.784392:0:5854:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787599193.784399:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc67411822e2 00000020:00000080:2.0:1787599193.784626:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787599193.784631:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599193.784634:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599193.784635:0:5854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787599193.784638:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599193.784641:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599193.784642:0:5854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787599193.784645:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599193.784659:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a60a4d05) 00000020:00000080:2.0:1787599193.784670:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787599193.784675:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787599193.784677:0:5854:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787599193.784679:0:5854:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787599193.784684:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787599193.784734:0:5854:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000474d0f98 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787599193.784746:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000775cea5a) 00000020:00000080:2.0:1787599193.784754:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787599193.784816:0:5854:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787599193.784823:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa46cbc67411822f7 00000020:00000080:2.0:1787599193.784905:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787599193.784916:0:5854:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787599193.784920:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa46cbc67411822fe 00080000:01000000:2.0:1787599193.784925:0:5854:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787599193.784928:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc6741182305 00080000:10000000:2.0:1787599193.788540:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1787599193.788760:0:5854:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787599193.796132:0:5854:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787599193.948946:0:5854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787599193.950425:0:5854:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787599193.954526:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787599193.954797:0:5854:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787599194.011722:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000addb8370) 00000020:00000080:1.0:1787599194.011744:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787599194.011840:0:5854:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787599194.011846:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc6741182313 00000020:00000080:0.0:1787599194.013881:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787599194.016883:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00010000:00010000:3.0:1787599194.081944:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787599194.086717:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787599194.159201:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787599194.192046:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787599194.228501:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787599194.259857:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787599194.297711:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa46cbc674118231a 00000020:00000080:3.0:1787599194.298370:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787599194.298381:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599194.298387:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599194.298390:0:5854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787599194.298393:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599194.298396:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599194.298398:0:5854:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787599194.298408:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787599194.298410:0:5854:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787599194.298413:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599194.298415:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599194.298416:0:5854:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787599194.298418:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599194.298423:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599194.298424:0:5854:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787599194.298428:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787599194.298465:0:5854:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787599194.298518:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab917dfc pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5854:1874433543243008:0@lo:502: 00000100:00100000:3.0:1787599194.298600:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599194.298743:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034ad5a95 going to sleep for 11 seconds 00000100:00100000:0.0:1787599194.298872:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543243008 00000100:00100000:0.0:1787599194.298880:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543243008 00000100:00100000:0.0:1787599194.298979:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599194.298987:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098f8ca7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+9:5854:x1874433543243008:12345-0@lo:502: 00000100:00100000:0.0:1787599194.299337:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098f8ca7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+9:5854:x1874433543243008:12345-0@lo:502: Request processed in 350us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599194.299345:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787599194.299432:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab917dfc pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5854:1874433543243008:0@lo:502: 00000020:01000000:3.0:1787599194.299457:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599194.299462:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599194.299464:0:5854:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787599194.299467:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787599194.299733:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787599194.299749:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787599194.299768:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000ed86ff4d/0xa46cbc67411822cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599194.299779:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000ed86ff4d/0xa46cbc67411822cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599194.299785:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f6c6dd51000 from 1 10000000:01000000:2.0:1787599194.299788:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787599194.299816:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599194.299823:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599194.299831:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599194.299844:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7e72361 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243136:0@lo:101: 00000100:00100000:2.0:1787599194.299876:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599194.300055:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cfd207ad going to sleep for 11 seconds 00000100:00100000:1.0:1787599194.300337:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543243136 00000100:00100000:1.0:1787599194.300346:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543243136 00000100:00100000:1.0:1787599194.300378:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599194.300384:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa60bb05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+9:5812:x1874433543243136:12345-0@lo:101: 00010000:00010000:1.0:1787599194.300395:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599194.300408:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000083f8933e/0xa46cbc6741182328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182321 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599194.300428:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083f8933e/0xa46cbc6741182328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182321 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599194.300436:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000083f8933e/0xa46cbc6741182328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182321 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599194.300444:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000083f8933e, rc 0) 00000100:00100000:1.0:1787599194.300524:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa60bb05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+10:5812:x1874433543243136:12345-0@lo:101: Request processed in 139us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599194.300530:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787599194.300606:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7e72361 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243136:0@lo:101: 00010000:00010000:3.0:1787599194.300618:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.300626:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599194.301153:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab917dfc pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243264:0@lo:256: 00000100:00100000:3.0:1787599194.301339:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599194.301364:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034ad5a95 going to sleep for 11 seconds 00000100:00100000:0.0:1787599194.301427:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543243264 00000100:00100000:0.0:1787599194.301433:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543243264 00000100:00100000:0.0:1787599194.301458:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599194.301465:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfbd3ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+10:5812:x1874433543243264:12345-0@lo:256: 20000000:01000000:0.0:1787599194.301481:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787599194.301486:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787599194.301553:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfbd3ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+10:5812:x1874433543243264:12345-0@lo:256: Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599194.301560:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599194.301637:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab917dfc pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243264:0@lo:256: 10000000:01000000:3.0:1787599194.302484:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787599194.302538:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.302548:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599194.302555:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c6dd51000 from 1 10000000:01000000:3.0:1787599194.302558:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599194.302584:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.302590:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.302598:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599194.302612:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab917dfc pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243392:0@lo:101: 00000100:00100000:3.0:1787599194.302648:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599194.302677:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034ad5a95 going to sleep for 11 seconds 00000100:00100000:2.0:1787599194.302715:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543243392 00000100:00100000:2.0:1787599194.302721:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543243392 00000100:00100000:2.0:1787599194.302756:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599194.302764:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000fba101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+10:5812:x1874433543243392:12345-0@lo:101: 00010000:00010000:2.0:1787599194.302774:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599194.302784:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001b0ec6e9/0xa46cbc6741182336 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118232f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599194.302801:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b0ec6e9/0xa46cbc6741182336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118232f expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599194.302810:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001b0ec6e9/0xa46cbc6741182336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118232f expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599194.302818:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001b0ec6e9, rc 0) 00000100:00100000:2.0:1787599194.302904:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000fba101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:5812:x1874433543243392:12345-0@lo:101: Request processed in 141us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599194.302910:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599194.302990:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab917dfc pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243392:0@lo:101: 00010000:00010000:3.0:1787599194.303001:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.303008:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599194.303049:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab917dfc pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243520:0@lo:501: 00000100:00100000:3.0:1787599194.303076:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599194.303125:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034ad5a95 going to sleep for 11 seconds 00000100:00100000:2.0:1787599194.303150:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543243520 00000100:00100000:2.0:1787599194.303153:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543243520 00000100:00100000:3.0:1787599194.303439:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787599194.303445:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2b42535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:5812:x1874433543243520:12345-0@lo:501: 00000100:00100000:3.0:1787599194.303984:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2b42535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:5812:x1874433543243520:12345-0@lo:501: Request processed in 539us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599194.303992:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599194.304057:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab917dfc pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243520:0@lo:501: 00000100:00100000:2.0:1787599194.304087:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af3faa88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243648:0@lo:503: 00000100:00100000:2.0:1787599194.304121:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599194.304231:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d601fd3 going to sleep for 11 seconds 00000100:00100000:1.0:1787599194.304412:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543243648 00000100:00100000:1.0:1787599194.304418:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543243648 00000100:00100000:1.0:1787599194.304440:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599194.304451:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3c6ec74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:5812:x1874433543243648:12345-0@lo:503: 00000040:00080000:1.0:1787599194.304482:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787599194.304517:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3c6ec74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:5812:x1874433543243648:12345-0@lo:503: Request processed in 66us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599194.304523:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599194.304603:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af3faa88 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243648:0@lo:503: 00000040:00080000:2.0:1787599194.305537:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787599194.305692:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787599194.305711:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787599194.305731:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599194.305740:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599194.305795:0:5812:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787599194.305798:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f6c6dd51000 10000000:01000000:1.0:1787599194.305800:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f6c6dd51000 10000000:01000000:1.0:1787599194.305804:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787599194.305809:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6c6dd51000 from 1 10000000:01000000:1.0:1787599194.305811:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787599194.305851:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000d5cdd0ee/0xa46cbc674118233d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599194.305859:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000d5cdd0ee/0xa46cbc674118233d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599194.305867:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000d5cdd0ee/0xa46cbc674118233d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599194.305883:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24981ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243776:0@lo:101: 00000100:00100000:1.0:1787599194.305925:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599194.305972:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce18db2a going to sleep for 11 seconds 00000100:00100000:1.0:1787599194.305989:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543243776 00000100:00100000:1.0:1787599194.305995:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543243776 00000100:00100000:1.0:1787599194.306018:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599194.306024:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4a552c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:5812:x1874433543243776:12345-0@lo:101: 00010000:00010000:1.0:1787599194.306032:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599194.306042:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fdbc2099/0xa46cbc6741182344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118233d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599194.306061:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fdbc2099/0xa46cbc6741182344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118233d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599194.306070:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fdbc2099/0xa46cbc6741182344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118233d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599194.306077:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fdbc2099, rc 0) 00000100:00100000:1.0:1787599194.306104:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4a552c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5812:x1874433543243776:12345-0@lo:101: Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599194.306109:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599194.306145:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24981ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243776:0@lo:101: 00010000:00010000:1.0:1787599194.306298:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000d5cdd0ee/0xa46cbc674118233d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599194.306306:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000d5cdd0ee/0xa46cbc674118233d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599194.306347:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24981ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243904:0@lo:501: 00000100:00100000:1.0:1787599194.306373:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599194.306386:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce18db2a going to sleep for 11 seconds 00000100:00100000:1.0:1787599194.306402:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543243904 00000100:00100000:1.0:1787599194.306405:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543243904 00000100:00100000:1.0:1787599194.306421:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599194.306426:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b822ef4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5812:x1874433543243904:12345-0@lo:501: 00000100:00100000:1.0:1787599194.306634:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b822ef4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5812:x1874433543243904:12345-0@lo:501: Request processed in 207us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599194.306640:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599194.306670:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24981ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543243904:0@lo:501: 00000100:00100000:1.0:1787599194.306691:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24981ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543244032:0@lo:503: 00000100:00100000:1.0:1787599194.306723:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599194.306736:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce18db2a going to sleep for 11 seconds 00000100:00100000:1.0:1787599194.306748:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543244032 00000100:00100000:1.0:1787599194.306752:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543244032 00000100:00100000:1.0:1787599194.306766:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599194.306770:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067b27c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5812:x1874433543244032:12345-0@lo:503: 00000100:00100000:1.0:1787599194.307042:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067b27c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5812:x1874433543244032:12345-0@lo:503: Request processed in 271us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599194.307048:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599194.307078:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24981ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543244032:0@lo:503: 00000100:00100000:2.0:1787599194.307498:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af3faa88 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5859:1874433543244160:0@lo:502: 00000100:00100000:2.0:1787599194.307539:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599194.307566:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000629bf6ae going to sleep for 11 seconds 00000100:00100000:3.0:1787599194.307606:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543244160 00000100:00100000:3.0:1787599194.307611:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543244160 00000100:00100000:3.0:1787599194.307640:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787599194.307646:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adfb051b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5859:x1874433543244160:12345-0@lo:502: 00000100:00100000:3.0:1787599194.307832:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adfb051b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5859:x1874433543244160:12345-0@lo:502: Request processed in 186us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599194.307838:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599194.307904:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af3faa88 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5859:1874433543244160:0@lo:502: 00000020:01000004:2.0:1787599194.307967:0:5859:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787599194.307982:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000993da400) 00000020:00000080:2.0:1787599194.307998:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787599194.308057:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000474d0f98 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787599194.308060:0:5859:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000474d0f98 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787599194.308062:0:5859:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000474d0f98 4 00010000:00080000:2.0:1787599194.308087:0:5859:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d519249b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1787599194.310627:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787599194.310860:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787599194.310903:0:5859:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787599194.310918:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa46cbc6741182352 00000100:00080000:3.0:1787599194.310939:0:5859:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599194.310944:0:5859:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d519249b using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787599194.310978:0:5859:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e5dc8a8c x1874433543244288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599194.311009:0:5859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787599194.311546:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5dc8a8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874433543244288:0@lo:38: 00000100:00100000:0.0:1787599194.311625:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599194.311733:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543244288 00000100:00100000:3.0:1787599194.311740:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543244288 00000100:00100000:3.0:1787599194.311777:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599194.311784:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c748d3f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874433543244288:12345-0@lo:38: 00000100:00100000:3.0:1787599194.311845:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c748d3f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874433543244288:12345-0@lo:38: Request processed in 59us (220us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787599194.311852:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599194.311889:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599194.311896:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000d519249b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599194.311900:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787599194.311902:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5dc8a8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874433543244288:0@lo:38: 00000100:00100000:1.0:1787599194.312035:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24981ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5859:1874433543244416:0@lo:502: 00000100:00100000:1.0:1787599194.312079:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599194.312104:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543244416 00000100:00100000:1.0:1787599194.312108:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543244416 00000100:00100000:1.0:1787599194.312140:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599194.312146:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007372fe75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5859:x1874433543244416:12345-0@lo:502: 00000100:00100000:1.0:1787599194.312510:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007372fe75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5859:x1874433543244416:12345-0@lo:502: Request processed in 364us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599194.312523:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599194.312557:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce18db2a going to sleep for 11 seconds 00000100:00100000:1.0:1787599194.312571:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24981ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5859:1874433543244416:0@lo:502: 00000040:00080000:1.0:1787599194.312593:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787599194.312750:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787599194.312767:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787599194.312785:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000d5cdd0ee/0xa46cbc674118233d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.312795:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000d5cdd0ee/0xa46cbc674118233d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787599194.312838:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787599194.312841:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787599194.312843:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599194.312844:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599194.312845:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599194.312847:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599194.312848:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599194.312849:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787599194.312851:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599194.312852:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599194.312854:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599194.312855:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599194.312859:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787599194.312862:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599194.312863:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787599194.312865:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599194.312866:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599194.312867:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599194.312872:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599194.312873:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599194.312874:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787599194.312875:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599194.312876:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599194.312877:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599194.312878:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599194.312893:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787599194.312901:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5dc8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543244544:0@lo:253: 00000100:00100000:3.0:1787599194.312946:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599194.312967:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063884711 going to sleep for 11 seconds 00000100:00100000:1.0:1787599194.313214:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543244544 00000100:00100000:1.0:1787599194.313219:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543244544 00000100:00100000:1.0:1787599194.313253:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599194.313260:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e298bff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5812:x1874433543244544:12345-0@lo:253: 20000000:01000000:1.0:1787599194.313282:0:5824:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787599194.313298:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787599194.345657:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787599194.345745:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787599194.345864:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787599194.345869:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787599194.345954:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599194.345974:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000083f8933e/0xa46cbc6741182328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182321 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599194.345982:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599194.346021:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000083f8933e/0xa46cbc6741182328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741182321 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599194.346036:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000083f8933e/0xa46cbc6741182328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741182321 expref: 12 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599194.346052:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec94fea9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874433543244672:0@lo:104: 00000100:00100000:0.0:1787599194.346115:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599194.346243:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 0000000096f20bb6 going to sleep for 11 seconds 00000100:00100000:3.0:1787599194.349596:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543244672 00000100:00100000:3.0:1787599194.349612:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543244672 00000100:00100000:3.0:1787599194.349663:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599194.349672:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092edfd94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5847:x1874433543244672:12345-0@lo:104: 00010000:00010000:3.0:1787599194.349690:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.349776:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787599194.349781:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092edfd94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5847:x1874433543244672:12345-0@lo:104: Request processed in 111us (3667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599194.349788:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599194.349847:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec94fea9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874433543244672:0@lo:104: 00010000:00010000:3.0:1787599194.349870:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.349901:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599194.349906:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.349913:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a22c0a6e already unused, calling callback (00000000428d1141) 10000000:00010000:3.0:1787599194.349940:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.349949:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599194.349956:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599194.349962:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599194.349995:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350001:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599194.350015:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350021:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 00000000a22c0a6e/0xa46cbc6741182321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182328 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350038:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599194.350040:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599194.350042:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599194.350100:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543244800:0@lo:103: 00000100:00100000:3.0:1787599194.350136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599194.350270:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543244800 00000100:00100000:3.0:1787599194.350274:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543244800 00010000:00010000:3.0:1787599194.350291:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000083f8933e/0xa46cbc6741182328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182321 expref: 13 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599194.350311:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599194.350323:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088dd97f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:3300:x1874433543244800:12345-0@lo:103: 00010000:00010000:3.0:1787599194.350333:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599194.350338:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000083f8933e/0xa46cbc6741182328 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182321 expref: 13 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350347:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000083f8933e/0xa46cbc6741182328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741182321 expref: 13 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350359:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000083f8933e/0xa46cbc6741182328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741182321 expref: 13 pid: 5826 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350373:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350380:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787599194.350392:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004523687s 00010000:00010000:3.0:1787599194.350395:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350401:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350407:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350413:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350418:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006b1e2193 already unused, calling callback (00000000a08c7468) 00010000:00010000:3.0:1787599194.350427:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350433:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350446:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350456:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599194.350485:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088dd97f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3300:x1874433543244800:12345-0@lo:103: Request processed in 163us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599194.350491:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787599194.350610:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350618:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599194.350624:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006b1e2193/0xa46cbc6741182359 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599194.350651:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543244800:0@lo:103: 00000100:00100000:3.0:1787599194.353031:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e298bff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:5812:x1874433543244544:12345-0@lo:253: Request processed in 39765us (40078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599194.353044:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787599194.353119:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5dc8a8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5812:1874433543244544:0@lo:253: 10000000:01000000:0.0:1787599194.353133:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787599194.353136:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787599194.353138:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599194.353139:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599194.353140:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599194.353141:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599194.353142:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599194.353143:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599194.353145:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599194.353146:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787599194.353326:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787599194.353328:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599194.353329:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787599194.353343:0:5812:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787599194.364967:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787599194.365613:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787599194.365905:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787599194.366093:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787599194.366561:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787599194.366763:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787599194.367570:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787599194.367763:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787599194.367957:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787599194.368132:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787599194.368754:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787599194.368923:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787599194.412000:0:5812:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787599194.442797:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787599194.443087:0:5865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1787599194.446523:0:5864:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787599194.446532:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787599194.447780:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787599194.452987:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787599194.453517:0:5812:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787599194.453529:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787599194.453678:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599194.454790:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787599194.455413:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787599194.455441:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787599194.455655:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787599194.455850:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787599194.459793:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787599194.459936:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787599194.460086:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787599194.460264:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787599194.460391:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787599194.460546:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787599194.460728:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787599194.460861:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787599194.461018:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787599194.461197:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787599194.461343:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787599194.461491:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787599194.463367:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787599194.463542:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787599194.463698:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787599194.463828:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787599194.464134:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787599194.468013:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787599194.468342:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787599194.468491:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787599194.468638:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787599194.468794:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787599194.468994:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787599194.469193:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787599194.469658:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787599194.469797:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787599194.469966:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787599194.470104:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787599194.472666:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787599194.472853:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787599194.473064:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787599194.473451:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787599194.473652:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787599194.486481:0:5865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787599194.538005:0:5812:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787599194.538047:0:5812:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc2c3816cb988 00100000:10000000:2.0:1787599194.538054:0:5812:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787599194.538921:0:5812:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787599194.538954:0:5812:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787599194.538967:0:5812:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787599194.538983:0:5812:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787599194.547047:0:5865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787599194.547121:0:5865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787599194.547125:0:5865:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787599195.111340:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599196.129637:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599197.154285:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599198.178406:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787599199.150305:0:6108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787599199.201375:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787599199.270321:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787599199.270330:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f6c6dd51000 from 3 10000000:01000000:2.0:1787599199.270335:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787599199.270380:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 00000000e7889f22/0xa46cbc6741182360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599199.270392:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 00000000e7889f22/0xa46cbc6741182360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599199.270401:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 00000000e7889f22/0xa46cbc6741182360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599199.270422:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af3faa88 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543244928:0@lo:101: 00000100:00100000:2.0:1787599199.270495:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599199.270537:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 000000000917b31b going to sleep for 11 seconds 00000100:00100000:3.0:1787599199.271367:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543244928 00000100:00100000:3.0:1787599199.271377:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543244928 00000100:00100000:3.0:1787599199.271435:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787599199.271443:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1a52037 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:5828:x1874433543244928:12345-0@lo:101: 00010000:00010000:3.0:1787599199.271456:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599199.271469:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b596fff8/0xa46cbc6741182367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182360 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599199.271491:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b596fff8/0xa46cbc6741182367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182360 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599199.271500:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b596fff8/0xa46cbc6741182367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182360 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599199.271508:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b596fff8, rc 0) 00000100:00100000:3.0:1787599199.271556:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1a52037 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5828:x1874433543244928:12345-0@lo:101: Request processed in 114us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599199.271562:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787599199.271650:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af3faa88 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543244928:0@lo:101: 00010000:00010000:2.0:1787599199.271663:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 00000000e7889f22/0xa46cbc6741182360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599199.271672:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 00000000e7889f22/0xa46cbc6741182360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599199.271721:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af3faa88 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543245056:0@lo:256: 00000100:00100000:2.0:1787599199.271757:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599199.271788:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 000000000917b31b going to sleep for 11 seconds 00000100:00100000:3.0:1787599199.271830:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543245056 00000100:00100000:3.0:1787599199.271845:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543245056 00000100:00100000:3.0:1787599199.271875:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599199.271881:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004eea3586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5828:x1874433543245056:12345-0@lo:256: 20000000:01000000:3.0:1787599199.271901:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787599199.272003:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787599199.272007:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787599199.272083:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004eea3586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5828:x1874433543245056:12345-0@lo:256: Request processed in 203us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599199.272090:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787599199.272178:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af3faa88 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543245056:0@lo:256: 10000000:01000000:2.0:1787599199.272215:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787599199.272220:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: 00000000e7889f22/0xa46cbc6741182360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599199.272227:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: 00000000e7889f22/0xa46cbc6741182360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787599199.777273:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787599199.777284:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787599199.777287:0:37:0:(import.c:65:import_set_state_nolock()) 00000000d519249b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599199.777315:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d519249b using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1787599199.777337:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004748fa8d x1874433543245312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599199.777414:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599199.777427:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e24981ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543245184:0@lo:400: 00000100:00100000:1.0:1787599199.777502:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599199.777573:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004748fa8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874433543245312:0@lo:38: 00000100:00100000:1.0:1787599199.778016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599199.781345:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543245184 00000100:00100000:2.0:1787599199.781360:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543245184 00000100:00100000:2.0:1787599199.781409:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787599199.781418:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c88583f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3302:x1874433543245184:12345-0@lo:400: 00000100:00100000:2.0:1787599199.781510:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c88583f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3302:x1874433543245184:12345-0@lo:400: Request processed in 93us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599199.781517:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787599199.781599:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e24981ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543245184:0@lo:400: 00000100:00100000:3.0:1787599199.782954:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543245312 00000100:00100000:3.0:1787599199.782968:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543245312 00000100:00100000:3.0:1787599199.783009:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599199.783016:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002855bbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1874433543245312:12345-0@lo:38: 00010000:00080000:3.0:1787599199.783048:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:3.0:1787599199.783110:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa46cbc674118236e 00000004:00100000:3.0:1787599199.783584:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787599199.783862:0:5833:0:(import.c:65:import_set_state_nolock()) 000000001df04eeb : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599199.783958:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002855bbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874433543245312:12345-0@lo:38: Request processed in 940us (5942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599199.783968:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787599199.785191:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004748fa8d x1874433543245312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599199.785212:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787599199.785255:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787599199.785261:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787599199.785264:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000d519249b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787599199.785271:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004748fa8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874433543245312:0@lo:38: 00010000:00010000:1.0:1787599200.228776:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599201.249587:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599202.281825:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599203.301862:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599204.321402:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787599204.407031:0:6309:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc2077400 20000000:00000080:2.0:1787599204.407051:0:6309:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f6c75852000 uarg=0000000000000000 20000000:01000000:2.0:1787599204.407503:0:6309:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787599204.407511:0:6309:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787599204.407516:0:6309:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787599204.407760:0:6309:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787599204.407772:0:6309:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787599204.414547:0:6309:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599204.414826:0:6309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787599204.414879:0:6309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787599204.414940:0:6309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787599204.414957:0:6309:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787599204.414972:0:6309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599204.414990:0:6309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001b0ec6e9/0xa46cbc6741182336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118232f expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599204.414997:0:6309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599204.415108:0:6309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001b0ec6e9/0xa46cbc6741182336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc674118232f expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599204.415124:0:6309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001b0ec6e9/0xa46cbc6741182336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc674118232f expref: 11 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599204.415137:0:6309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af3faa88 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6309:1874433543245440:0@lo:104: 00000100:00100000:2.0:1787599204.416188:0:6309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599204.416242:0:6309:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034ad5a95 going to sleep for 11 seconds 00000100:00100000:3.0:1787599204.416387:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543245440 00000100:00100000:3.0:1787599204.416395:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543245440 00000100:00100000:3.0:1787599204.416449:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599204.416458:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b42127 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:6309:x1874433543245440:12345-0@lo:104: 00010000:00010000:3.0:1787599204.416472:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416527:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787599204.416532:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b42127 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:6309:x1874433543245440:12345-0@lo:104: Request processed in 76us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599204.416548:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787599204.416569:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599204.416574:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416581:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007b130bd6 already unused, calling callback (00000000428d1141) 10000000:00010000:3.0:1787599204.416584:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416591:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599204.416597:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599204.416603:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787599204.416632:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416639:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599204.416655:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416661:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118232f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182336 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416679:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599204.416680:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599204.416682:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599204.416700:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543245568:0@lo:103: 00000100:00100000:3.0:1787599204.416748:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599204.416785:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543245568 00000100:00100000:3.0:1787599204.416788:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543245568 00010000:00010000:3.0:1787599204.416804:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001b0ec6e9/0xa46cbc6741182336 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118232f expref: 12 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599204.416824:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599204.416831:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000922539e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3302:x1874433543245568:12345-0@lo:103: 00010000:00010000:3.0:1787599204.416840:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599204.416844:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001b0ec6e9/0xa46cbc6741182336 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118232f expref: 12 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416854:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001b0ec6e9/0xa46cbc6741182336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc674118232f expref: 12 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416870:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416877:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416890:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416896:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416902:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416907:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416918:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c63a404d already unused, calling callback (00000000a08c7468) 00010000:00010000:3.0:1787599204.416921:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416928:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416936:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599204.416944:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599204.416969:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000922539e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3302:x1874433543245568:12345-0@lo:103: Request processed in 140us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599204.416975:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599204.418954:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543245568:0@lo:103: 00010000:00010000:2.0:1787599204.419402:0:6309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001b0ec6e9/0xa46cbc6741182336 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc674118232f expref: 11 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599204.419419:0:6309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af3faa88 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6309:1874433543245440:0@lo:104: 00010000:00010000:2.0:1787599204.419437:0:6309:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599204.419446:0:6309:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599204.419452:0:6309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599204.419470:0:6309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c63a404d/0xa46cbc6741182375 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599204.903382:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f0dadc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543245824:0@lo:400: 00000100:00100000:0.0:1787599204.903453:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599204.903519:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599204.903525:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af6cb074 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543245696:0@lo:400: 00000100:00100000:0.0:1787599204.903555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599204.903590:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543245824 00000100:00100000:0.0:1787599204.903597:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543245824 00000100:00100000:0.0:1787599204.903641:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599204.903650:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031f03bd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543245824:12345-0@lo:400: 00000100:00100000:0.0:1787599204.903704:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031f03bd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543245824:12345-0@lo:400: Request processed in 55us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599204.903712:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599204.903785:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543245696 00000100:00100000:0.0:1787599204.903790:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543245696 00000100:00100000:0.0:1787599204.903814:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787599204.903819:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2de0e78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:3300:x1874433543245696:12345-0@lo:400: 00000100:00100000:0.0:1787599204.903848:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2de0e78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:3300:x1874433543245696:12345-0@lo:400: Request processed in 30us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599204.903854:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787599204.903894:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af6cb074 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543245696:0@lo:400: 00010000:00080000:0.0:1787599204.903921:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006f0dadc1 x1874433543245824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599204.903931:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f0dadc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543245824:0@lo:400: 00010000:00010000:1.0:1787599205.346362:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599206.371568:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787599206.756383:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599206.756391:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c6dd51000 from 1 10000000:01000000:3.0:1787599206.756396:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599206.756442:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118237c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599206.756455:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118237c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599206.756478:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118237c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599206.756503:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543245952:0@lo:101: 00000100:00100000:3.0:1787599206.756572:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599206.756629:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fecae07b going to sleep for 11 seconds 00000100:00100000:3.0:1787599206.756652:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543245952 00000100:00100000:3.0:1787599206.756659:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543245952 00000100:00100000:3.0:1787599206.756719:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599206.756729:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062b64340 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:5828:x1874433543245952:12345-0@lo:101: 00010000:00010000:3.0:1787599206.756741:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599206.756753:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef7dfe5d/0xa46cbc6741182383 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118237c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599206.756775:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef7dfe5d/0xa46cbc6741182383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118237c expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599206.756784:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef7dfe5d/0xa46cbc6741182383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118237c expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599206.756792:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef7dfe5d, rc 0) 00000100:00100000:3.0:1787599206.756831:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062b64340 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5828:x1874433543245952:12345-0@lo:101: Request processed in 104us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599206.756838:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599206.756884:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543245952:0@lo:101: 00010000:00010000:3.0:1787599206.756897:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118237c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599206.756905:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: 000000007b130bd6/0xa46cbc674118237c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599206.756953:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543246080:0@lo:501: 00000100:00100000:3.0:1787599206.756991:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599206.757005:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fecae07b going to sleep for 11 seconds 00000100:00100000:3.0:1787599206.757023:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543246080 00000100:00100000:3.0:1787599206.757027:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543246080 00000100:00100000:3.0:1787599206.757047:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599206.757053:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3e792c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5828:x1874433543246080:12345-0@lo:501: 00000100:00100000:3.0:1787599206.757303:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3e792c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5828:x1874433543246080:12345-0@lo:501: Request processed in 249us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599206.757310:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599206.757339:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543246080:0@lo:501: 00000100:00100000:3.0:1787599206.757362:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543246208:0@lo:503: 00000100:00100000:3.0:1787599206.757398:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599206.757410:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fecae07b going to sleep for 11 seconds 00000100:00100000:3.0:1787599206.757422:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543246208 00000100:00100000:3.0:1787599206.757425:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543246208 00000100:00100000:3.0:1787599206.757445:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599206.757450:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044fd761c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5828:x1874433543246208:12345-0@lo:503: 00000100:00100000:3.0:1787599206.757660:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044fd761c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5828:x1874433543246208:12345-0@lo:503: Request processed in 209us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599206.757667:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599206.757716:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543246208:0@lo:503: 00000100:00100000:3.0:1787599206.757884:0:6384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6384:1874433543246336:0@lo:502: 00000100:00100000:3.0:1787599206.757917:0:6384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599206.757937:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543246336 00000100:00100000:3.0:1787599206.757940:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543246336 00000100:00100000:3.0:1787599206.757959:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599206.757964:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000004379b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6384:x1874433543246336:12345-0@lo:502: 00000100:00100000:3.0:1787599206.758097:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000004379b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6384:x1874433543246336:12345-0@lo:502: Request processed in 133us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599206.758112:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599206.758143:0:6384:0:(client.c:2715:ptlrpc_set_wait()) set 000000001f8a47ec going to sleep for 11 seconds 00000100:00100000:3.0:1787599206.758171:0:6384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089964c1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6384:1874433543246336:0@lo:502: 00000020:01000000:3.0:1787599206.758191:0:6384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599206.758200:0:6384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599206.758202:0:6384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787599206.758208:0:6384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6c6dd51000 00000020:00000080:3.0:1787599206.758210:0:6384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787599206.758248:0:6384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6384:1874433543246464:0@lo:502: 00000100:00100000:3.0:1787599206.758279:0:6384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599206.758297:0:6384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c481e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599206.758603:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543246464 00000100:00100000:1.0:1787599206.758608:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543246464 00000100:00100000:1.0:1787599206.758639:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787599206.758646:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6384:x1874433543246464:12345-0@lo:502: 00000100:00100000:1.0:1787599206.758818:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6384:x1874433543246464:12345-0@lo:502: Request processed in 171us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599206.758825:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599206.761444:0:6384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6384:1874433543246464:0@lo:502: 00000020:01000000:3.0:1787599206.761581:0:6384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599206.761596:0:6384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599206.761599:0:6384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787599206.761604:0:6384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787599206.761679:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787599206.761709:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599206.761719:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc674118237c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599206.761730:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc674118237c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599207.395061:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599208.418268:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599209.446783:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599210.018353:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543246592:0@lo:400: 00000100:00100000:0.0:1787599210.018425:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599210.018479:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599210.018485:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543246720:0@lo:400: 00000100:00100000:0.0:1787599210.018512:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599210.018546:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543246592 00000100:00100000:0.0:1787599210.018553:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543246592 00000100:00100000:0.0:1787599210.018598:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599210.018607:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3301:x1874433543246592:12345-0@lo:400: 00000100:00100000:0.0:1787599210.018667:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3301:x1874433543246592:12345-0@lo:400: Request processed in 61us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599210.018674:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787599210.018703:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543246720 00000100:00100000:0.0:1787599210.018707:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543246720 00000100:00100000:0.0:1787599210.018731:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599210.018737:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543246720:12345-0@lo:400: 00000100:00100000:0.0:1787599210.018768:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543246720:12345-0@lo:400: Request processed in 31us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599210.018774:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787599210.021301:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f6c466ece00 x1874433543246720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599210.021320:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543246720:0@lo:400: 00000100:00100000:0.0:1787599210.021349:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543246592:0@lo:400: 00010000:00010000:2.0:1787599210.466240:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787599211.317095:0:6674:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787599211.317100:0:6674:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787599211.317262:0:6674:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f6c50231800 00000020:01000004:3.0:1787599211.317279:0:6674:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787599211.317295:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787599211.317317:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f6c483319b8) 00000020:00000080:3.0:1787599211.317398:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787599211.332466:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787599211.332791:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787599211.357131:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787599211.363281:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787599211.363314:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787599211.363366:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787599211.363744:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787599211.364307:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787599211.364320:0:6674:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787599211.364334:0:6674:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa46cbc6741182391 00000020:01000004:2.0:1787599211.364343:0:6674:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787599211.364366:0:6674:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787599211.364370:0:6674:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787599211.364449:0:6674:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787599211.364455:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787599211.364468:0:6674:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f6c76713370) 00000020:00000080:2.0:1787599211.364481:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787599211.367739:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599211.368654:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787599211.368663:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787599211.372558:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787599211.372569:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787599211.375633:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787599211.375645:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787599211.377774:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599211.378117:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787599211.378132:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787599211.382674:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787599211.382692:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787599211.406318:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599211.409300:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787599211.409317:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787599211.412213:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787599211.412234:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787599211.413235:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787599211.413243:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787599211.417846:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599211.418400:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787599211.418406:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787599211.419527:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787599211.419537:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787599211.467755:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599211.467973:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787599211.467980:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787599211.469498:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787599211.469511:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787599211.469878:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787599211.469902:0:6674:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787599211.469909:0:6674:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:3.0:1787599211.489455:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787599211.491454:0:6674:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787599211.491492:0:6674:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787599211.491497:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787599211.491499:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787599211.491500:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599211.491501:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599211.491503:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599211.491504:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599211.491506:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787599211.491507:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787599211.491509:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787599211.491511:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599211.491512:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787599211.491518:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787599211.491520:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787599211.491521:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787599211.491522:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599211.491523:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599211.491524:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599211.491526:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599211.491527:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787599211.491528:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787599211.491529:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787599211.491530:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599211.491531:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787599211.491560:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787599211.491581:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543246848:0@lo:253: 00000100:00100000:1.0:1787599211.491664:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599211.491794:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7f7dd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599211.491891:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543246848 00000100:00100000:3.0:1787599211.491898:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543246848 00000100:00100000:3.0:1787599211.491985:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787599211.491996:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543246848:12345-0@lo:253: 20000000:01000000:3.0:1787599211.492028:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787599211.492032:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787599211.492037:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787599211.492041:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787599211.493143:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599211.493870:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787599211.493891:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787599211.493934:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787599211.493942:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787599211.493973:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787599211.496335:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787599211.496903:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787599211.496927:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.130@tcp 20000000:01000000:2.0:1787599211.496930:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:2.0:1787599211.496968:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787599211.496977:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787599211.497025:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787599211.497033:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:2.0:1787599211.497064:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787599211.497073:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787599211.497105:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787599211.497588:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787599211.498882:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787599211.498909:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.130@tcp 20000000:01000000:2.0:1787599211.498911:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:2.0:1787599211.498961:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787599211.498969:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787599211.498999:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787599211.499007:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:2.0:1787599211.499080:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787599211.499091:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787599211.499123:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787599211.499635:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787599211.499657:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787599211.499659:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787599211.499665:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787599211.499667:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787599211.499669:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787599211.499693:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787599211.499695:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787599211.499734:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787599211.499736:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787599211.500324:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787599211.500698:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787599211.500736:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787599211.500801:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787599211.500815:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787599211.500817:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787599211.501565:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787599211.501635:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787599211.501692:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787599211.501942:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787599211.501980:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787599211.502034:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787599211.502047:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787599211.502049:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787599211.503034:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787599211.503098:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787599211.505493:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787599211.506033:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787599211.506081:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787599211.506120:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1787599211.506152:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787599211.506203:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.506224:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c820f8600/0xa46cbc67411822b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411822b1 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.506232:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c820f9400/0xa46cbc67411822d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411822cd expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.506239:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c7d00e800/0xa46cbc6741182344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118233d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.506246:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.506294:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c7d00e800/0xa46cbc6741182344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc674118233d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.506329:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c7d00e800/0xa46cbc6741182344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc674118233d expref: 12 pid: 5826 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599211.506343:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874433543246976:0@lo:104: 00000100:00100000:3.0:1787599211.506424:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599211.506508:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c820f9400/0xa46cbc67411822d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411822cd expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.506517:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c820f9400/0xa46cbc67411822d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411822cd expref: 12 pid: 5824 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599211.506526:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874433543247104:0@lo:104: 00000100:00100000:3.0:1787599211.506549:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599211.506580:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c820f8600/0xa46cbc67411822b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411822b1 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.506588:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c820f8600/0xa46cbc67411822b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411822b1 expref: 12 pid: 5824 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599211.506595:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874433543247232:0@lo:104: 00000100:00100000:3.0:1787599211.506626:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599211.506638:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5003e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599211.506804:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543246976 00000100:00100000:2.0:1787599211.506813:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543246976 00000100:00100000:2.0:1787599211.506853:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543247104 00000100:00100000:2.0:1787599211.506856:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543247104 00000100:00100000:2.0:1787599211.506867:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543247232 00000100:00100000:2.0:1787599211.506869:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543247232 00000100:00100000:2.0:1787599211.506883:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599211.506891:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:5825:x1874433543246976:12345-0@lo:104: 00010000:00010000:2.0:1787599211.506904:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00f000/0xa46cbc674118233d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.506968:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599211.506975:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:5825:x1874433543246976:12345-0@lo:104: Request processed in 84us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.506982:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599211.506997:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599211.507002:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:5825:x1874433543247104:12345-0@lo:104: 00010000:00010000:2.0:1787599211.507009:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8200/0xa46cbc67411822cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507040:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787599211.507044:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:5825:x1874433543247104:12345-0@lo:104: Request processed in 43us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.507049:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599211.507060:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599211.507065:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5825:x1874433543247232:12345-0@lo:104: 00010000:00010000:2.0:1787599211.507071:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d800/0xa46cbc67411822b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507113:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787599211.507118:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5825:x1874433543247232:12345-0@lo:104: Request processed in 53us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.507123:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787599211.507140:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787599211.507145:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00f000/0xa46cbc674118233d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507152:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c7d00f000 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:2.0:1787599211.507178:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00f000/0xa46cbc674118233d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507188:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00f000/0xa46cbc674118233d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599211.507195:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00f000/0xa46cbc674118233d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599211.507201:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599211.507228:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00f000/0xa46cbc674118233d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507235:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599211.507253:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00f000/0xa46cbc674118233d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507260:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00f000/0xa46cbc674118233d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182344 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507285:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599211.507288:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8200/0xa46cbc67411822cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507294:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c820f8200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:2.0:1787599211.507298:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8200/0xa46cbc67411822cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507304:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8200/0xa46cbc67411822cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599211.507311:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8200/0xa46cbc67411822cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599211.507315:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599211.507330:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8200/0xa46cbc67411822cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507336:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599211.507341:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8200/0xa46cbc67411822cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507347:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8200/0xa46cbc67411822cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411822d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507356:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599211.507359:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d800/0xa46cbc67411822b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507387:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:2.0:1787599211.507391:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d800/0xa46cbc67411822b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507399:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d800/0xa46cbc67411822b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599211.507404:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d800/0xa46cbc67411822b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599211.507409:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599211.507422:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d800/0xa46cbc67411822b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507427:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599211.507442:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d800/0xa46cbc67411822b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507449:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d800/0xa46cbc67411822b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411822b8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507463:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599211.507465:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599211.507467:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599211.507486:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543247360:0@lo:103: 00000100:00100000:2.0:1787599211.507515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.507546:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599211.507552:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543247488:0@lo:103: 00000100:00100000:2.0:1787599211.507583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.507623:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543247616:0@lo:103: 00000100:00100000:2.0:1787599211.507644:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.507677:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543247360 00000100:00100000:2.0:1787599211.507682:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543247360 00010000:00010000:2.0:1787599211.507702:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c7d00e800/0xa46cbc6741182344 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118233d expref: 13 pid: 5826 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599211.507716:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543247488 00000100:00100000:2.0:1787599211.507719:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543247488 00010000:00010000:2.0:1787599211.507728:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c820f9400/0xa46cbc67411822d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411822cd expref: 14 pid: 5824 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599211.507737:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543247616 00000100:00100000:2.0:1787599211.507739:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543247616 00010000:00010000:2.0:1787599211.507759:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c820f8600/0xa46cbc67411822b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411822b1 expref: 15 pid: 5824 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599211.507772:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599211.507778:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:3299:x1874433543247360:12345-0@lo:103: 00010000:00010000:2.0:1787599211.507786:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599211.507791:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c7d00e800/0xa46cbc6741182344 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118233d expref: 15 pid: 5826 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507801:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c7d00e800/0xa46cbc6741182344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc674118233d expref: 15 pid: 5826 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507816:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599211.507842:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:3299:x1874433543247360:12345-0@lo:103: Request processed in 65us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.507858:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599211.507872:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599211.507879:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:3299:x1874433543247488:12345-0@lo:103: 00010000:00010000:2.0:1787599211.507886:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599211.507890:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c820f9400/0xa46cbc67411822d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411822cd expref: 14 pid: 5824 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507898:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c820f9400/0xa46cbc67411822d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411822cd expref: 14 pid: 5824 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507907:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599211.507928:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:3299:x1874433543247488:12345-0@lo:103: Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.507934:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599211.507945:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599211.507951:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:3301:x1874433543247616:12345-0@lo:103: 00010000:00010000:2.0:1787599211.507959:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599211.507963:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c820f8600/0xa46cbc67411822b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411822b1 expref: 13 pid: 5824 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507971:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c820f8600/0xa46cbc67411822b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411822b1 expref: 13 pid: 5824 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507981:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.507988:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.508009:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.508016:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.508023:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.508029:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.508035:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24ca00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599211.508039:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.508046:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.508054:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.508063:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599211.508090:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:3301:x1874433543247616:12345-0@lo:103: Request processed in 139us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.508096:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787599211.508119:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599211.508140:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543247616:0@lo:103: 00000100:00100000:2.0:1787599211.508194:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543247488:0@lo:103: 00000100:00100000:2.0:1787599211.508210:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543247360:0@lo:103: 00010000:00010000:3.0:1787599211.508434:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c7d00e800/0xa46cbc6741182344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc674118233d expref: 12 pid: 5826 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599211.508447:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874433543246976:0@lo:104: 00010000:00010000:3.0:1787599211.508459:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c820f9400/0xa46cbc67411822d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411822cd expref: 11 pid: 5824 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599211.508480:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874433543247104:0@lo:104: 00010000:00010000:3.0:1787599211.508492:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c820f8600/0xa46cbc67411822b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411822b1 expref: 10 pid: 5824 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599211.508500:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874433543247232:0@lo:104: 00010000:00010000:3.0:1787599211.508519:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.508527:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.508532:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.508537:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc674118239f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787599211.508549:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787599211.558323:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+9:6674:x1874433543246848:12345-0@lo:253: Request processed in 66321us (66651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599211.558339:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787599211.558551:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543246848:0@lo:253: 10000000:01000000:1.0:1787599211.558565:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787599211.558568:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787599211.558570:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787599211.558586:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599211.558587:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787599211.558589:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599211.558590:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599211.558592:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787599211.558593:0:6674:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787599211.558603:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599211.558605:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787599211.558624:0:6674:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f6c50231800 from lustre-OST0000 10000000:01000000:1.0:1787599211.558660:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787599211.558663:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787599211.558669:0:6674:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f6c50f78000 local copy 10000000:01000000:1.0:1787599211.558673:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787599211.558707:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.558718:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.558728:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599211.558744:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543247744:0@lo:101: 00000100:00100000:1.0:1787599211.558777:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599211.558827:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7f7dd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599211.558881:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543247744 00000100:00100000:3.0:1787599211.558887:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543247744 00000100:00100000:3.0:1787599211.558931:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787599211.558940:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+9:6674:x1874433543247744:12345-0@lo:101: 00010000:00010000:3.0:1787599211.558953:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599211.558967:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411823ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411823a6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.558998:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411823ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411823a6 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.559008:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411823ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411823a6 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.559018:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24ca00, rc 0) 00000100:00100000:3.0:1787599211.559044:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+10:6674:x1874433543247744:12345-0@lo:101: Request processed in 106us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599211.559050:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787599211.559276:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543247744:0@lo:101: 00010000:00010000:1.0:1787599211.559289:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.559298:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599211.559404:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543247872:0@lo:501: 00000100:00100000:1.0:1787599211.559435:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599211.559461:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7f7dd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599211.559562:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543247872 00000100:00100000:3.0:1787599211.559567:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543247872 00000100:00100000:3.0:1787599211.559604:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787599211.559612:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+10:6674:x1874433543247872:12345-0@lo:501: 00000100:00100000:3.0:1787599211.559789:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+10:6674:x1874433543247872:12345-0@lo:501: Request processed in 177us (352us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787599211.559796:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787599211.559866:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543247872:0@lo:501: 10000000:01000000:1.0:1787599211.559889:0:6674:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787599211.559914:0:6674:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787599211.559919:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.559928:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.559935:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.559959:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787599211.559976:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f6c50231800 10000000:01000000:1.0:1787599211.559981:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787599211.559985:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f6c50f78000 10000000:01000000:1.0:1787599211.559987:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787599211.559990:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f6c50f78000 from 1 10000000:01000000:1.0:1787599211.559992:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787599211.560007:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00e800/0xa46cbc67411823b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.560014:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00e800/0xa46cbc67411823b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.560021:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00e800/0xa46cbc67411823b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599211.560041:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248000:0@lo:101: 00000100:00100000:1.0:1787599211.560067:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599211.560081:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7f7dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599211.560095:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543248000 00000100:00100000:1.0:1787599211.560108:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543248000 00010000:00010000:3.0:1787599211.560246:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599211.560252:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.560260:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c7d00fa00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599211.560263:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.560271:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599211.560289:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599211.560294:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599211.560313:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.560318:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599211.560332:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.560339:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00fa00/0xa46cbc67411823a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa46cbc67411823ad expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.560353:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599211.560355:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599211.560357:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599211.560516:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787599211.560526:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+10:6674:x1874433543248000:12345-0@lo:101: 00010000:00010000:1.0:1787599211.560534:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599211.560546:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c7d00f000/0xa46cbc67411823bb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411823b4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.560561:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c7d00f000/0xa46cbc67411823bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411823b4 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.560570:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c7d00f000/0xa46cbc67411823bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411823b4 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.560578:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c7d00f000, rc 0) 00000100:00100000:1.0:1787599211.560630:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:6674:x1874433543248000:12345-0@lo:101: Request processed in 106us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599211.560635:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599211.560710:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248000:0@lo:101: 00010000:00010000:3.0:1787599211.560723:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00e800/0xa46cbc67411823b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.560731:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00e800/0xa46cbc67411823b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411823bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599211.560745:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787599211.560753:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00e800/0xa46cbc67411823b4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.560760:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00e800/0xa46cbc67411823b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599211.560773:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787599211.560776:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787599211.560780:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787599211.560782:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787599211.560797:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.560803:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.560810:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599211.560821:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248256:0@lo:101: 00000100:00100000:3.0:1787599211.560849:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599211.560885:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58427000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599211.560980:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543248256 00000100:00100000:1.0:1787599211.560985:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543248256 00000100:00100000:1.0:1787599211.561019:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787599211.561026:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:6674:x1874433543248256:12345-0@lo:101: 00010000:00010000:1.0:1787599211.561033:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599211.561042:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c7d00fe00/0xa46cbc67411823c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411823c2 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.561061:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c7d00fe00/0xa46cbc67411823c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411823c2 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.561068:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c7d00fe00/0xa46cbc67411823c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411823c2 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.561074:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c7d00fe00, rc 0) 00000100:00100000:1.0:1787599211.561101:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543248256:12345-0@lo:101: Request processed in 74us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599211.561107:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599211.561265:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248256:0@lo:101: 00010000:00010000:3.0:1787599211.561275:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.561283:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599211.561356:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248384:0@lo:501: 00000100:00100000:3.0:1787599211.561393:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599211.561412:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58427000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599211.561525:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543248384 00000100:00100000:1.0:1787599211.561529:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543248384 00000100:00100000:1.0:1787599211.561561:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787599211.561569:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543248384:12345-0@lo:501: 00000100:00100000:1.0:1787599211.561795:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543248384:12345-0@lo:501: Request processed in 227us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599211.561802:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787599211.561825:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248384:0@lo:501: 00000100:00100000:1.0:1787599211.561850:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248512:0@lo:503: 00000100:00100000:1.0:1787599211.561986:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599211.562037:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58d9b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599211.562055:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543248512 00000100:00100000:1.0:1787599211.562059:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543248512 00000100:00100000:2.0:1787599211.562138:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543248128:0@lo:103: 00000100:00100000:2.0:1787599211.562191:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.562228:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543248128 00000100:00100000:2.0:1787599211.562232:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543248128 00000100:00100000:2.0:1787599211.562259:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599211.562265:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:3302:x1874433543248128:12345-0@lo:103: 00010000:00010000:2.0:1787599211.562274:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599211.562287:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411823ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411823a6 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.562300:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599211.562325:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3302:x1874433543248128:12345-0@lo:103: Request processed in 61us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.562331:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599211.562355:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543248128:0@lo:103: 00000100:00100000:3.0:1787599211.562733:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787599211.562750:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:6674:x1874433543248512:12345-0@lo:503: 00000100:00100000:3.0:1787599211.562920:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:6674:x1874433543248512:12345-0@lo:503: Request processed in 171us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599211.562927:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787599211.563070:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248512:0@lo:503: 00000040:00080000:0.0:1787599211.563647:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599211.563713:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248640:0@lo:502: 00000100:00100000:0.0:1787599211.563763:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599211.563812:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c758550c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599211.563883:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543248640 00000100:00100000:3.0:1787599211.563890:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543248640 00000100:00100000:3.0:1787599211.563931:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787599211.563940:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:6674:x1874433543248640:12345-0@lo:502: 00000100:00100000:3.0:1787599211.564103:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:6674:x1874433543248640:12345-0@lo:502: Request processed in 164us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599211.564110:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787599211.564239:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248640:0@lo:502: 00000040:00080000:2.0:1787599211.564514:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787599211.564565:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787599211.564614:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787599211.564665:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787599211.564703:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787599211.564737:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787599211.564764:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248768:0@lo:502: 00000100:00100000:2.0:1787599211.564803:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.565066:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b442a9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599211.565499:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543248768 00000100:00100000:1.0:1787599211.565508:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543248768 00000100:00100000:1.0:1787599211.565542:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787599211.565550:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:6674:x1874433543248768:12345-0@lo:502: 00000100:00100000:1.0:1787599211.565758:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:6674:x1874433543248768:12345-0@lo:502: Request processed in 207us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599211.565766:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787599211.565940:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248768:0@lo:502: 00000040:00080000:2.0:1787599211.566052:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787599211.566063:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787599211.566975:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599211.566983:0:6695:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787599211.566990:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599211.566992:0:6695:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787599211.566998:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599211.567013:0:6695:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f6c7f7b8000) 00000020:00000080:1.0:1787599211.567034:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787599211.567041:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787599211.567122:0:6695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6c50231800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787599211.567450:0:6695:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787599211.567460:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa46cbc67411823d7 00010000:00010000:1.0:1787599211.575563:0:6695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787599211.576447:0:6695:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787599211.581643:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787599211.583550:0:6695:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787599211.600010:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787599211.600795:0:6695:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787599211.605532:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787599211.605542:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599211.605551:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599211.605553:0:6695:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787599211.605557:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599211.605561:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599211.605562:0:6695:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787599211.605565:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599211.605566:0:6695:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787599211.605633:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599211.605636:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599211.605638:0:6695:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787599211.605641:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787599211.615783:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787599211.615832:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787599211.615853:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599211.615878:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599211.615887:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c50231800 from 1 10000000:01000000:0.0:1787599211.615890:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599211.615939:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599211.615961:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599211.615973:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599211.615998:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248896:0@lo:101: 00000100:00100000:0.0:1787599211.616069:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599211.616119:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599211.616185:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543248896 00000100:00100000:0.0:1787599211.616192:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543248896 00000100:00100000:0.0:1787599211.616238:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787599211.616247:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:6674:x1874433543248896:12345-0@lo:101: 00010000:00010000:0.0:1787599211.616261:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599211.616274:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40031000/0xa46cbc67411823e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411823de expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599211.616296:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40031000/0xa46cbc67411823e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411823de expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599211.616306:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40031000/0xa46cbc67411823e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411823de expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599211.616315:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031000, rc 0) 00000100:00100000:0.0:1787599211.616355:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543248896:12345-0@lo:101: Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599211.616362:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787599211.616625:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543248896:0@lo:101: 00010000:00010000:0.0:1787599211.616648:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599211.616657:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599211.616764:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249024:0@lo:501: 00000100:00100000:0.0:1787599211.616793:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599211.616810:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599211.616825:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543249024 00000100:00100000:0.0:1787599211.616828:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543249024 00000100:00100000:0.0:1787599211.616851:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599211.616858:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543249024:12345-0@lo:501: 00000100:00100000:0.0:1787599211.617492:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543249024:12345-0@lo:501: Request processed in 632us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599211.617500:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599211.617695:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249024:0@lo:501: 00000100:00100000:1.0:1787599211.617732:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70139c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249152:0@lo:503: 00000100:00100000:1.0:1787599211.618825:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599211.618923:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c51841e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599211.619033:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543249152 00000100:00100000:0.0:1787599211.619041:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543249152 00000100:00100000:0.0:1787599211.619092:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599211.619101:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543249152:12345-0@lo:503: 00000100:00100000:0.0:1787599211.619559:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543249152:12345-0@lo:503: Request processed in 459us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599211.619567:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787599211.622035:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70139c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249152:0@lo:503: 00000040:00080000:1.0:1787599211.622607:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787599211.622687:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70139c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249280:0@lo:502: 00000100:00100000:1.0:1787599211.622761:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599211.622816:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7f7ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599211.622940:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543249280 00000100:00100000:2.0:1787599211.622947:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543249280 00000100:00100000:2.0:1787599211.622996:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787599211.623006:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543249280:12345-0@lo:502: 00000100:00100000:2.0:1787599211.623501:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543249280:12345-0@lo:502: Request processed in 495us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.623509:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787599211.625542:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70139c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249280:0@lo:502: 00000040:00080000:1.0:1787599211.625884:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787599211.625955:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787599211.625995:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70139c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249408:0@lo:502: 00000100:00100000:1.0:1787599211.626060:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599211.626111:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c51841e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599211.626302:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543249408 00000100:00100000:2.0:1787599211.626309:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543249408 00000100:00100000:2.0:1787599211.626357:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787599211.626485:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543249408:12345-0@lo:502: 00000100:00100000:2.0:1787599211.626687:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543249408:12345-0@lo:502: Request processed in 313us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.626694:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787599211.627502:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70139c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249408:0@lo:502: 00000040:00080000:1.0:1787599211.627673:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787599211.627685:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787599211.630907:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599211.630921:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599211.630924:0:6699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787599211.630931:0:6699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6c50231800 00000020:00000080:1.0:1787599211.630934:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599211.630955:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599211.630959:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599211.630960:0:6699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787599211.630963:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787599211.634766:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787599211.634807:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599211.634833:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.634846:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599211.634931:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787599211.634935:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f6c50231800 10000000:01000000:2.0:1787599211.634938:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f6c50231800 10000000:01000000:2.0:1787599211.634942:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599211.634948:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6c50231800 from 1 10000000:01000000:2.0:1787599211.634951:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787599211.634989:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.634998:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.635009:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599211.635033:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249536:0@lo:101: 00000100:00100000:2.0:1787599211.635102:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.635262:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b442a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599211.636111:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543249536 00000100:00100000:1.0:1787599211.636121:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543249536 00000100:00100000:1.0:1787599211.636544:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787599211.636556:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543249536:12345-0@lo:101: 00010000:00010000:1.0:1787599211.636572:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599211.636588:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c7d00e400/0xa46cbc67411823f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411823ec expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.636625:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c7d00e400/0xa46cbc67411823f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411823ec expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.636636:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c7d00e400/0xa46cbc67411823f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411823ec expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.636660:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c7d00e400, rc 0) 00000100:00100000:1.0:1787599211.636738:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6674:x1874433543249536:12345-0@lo:101: Request processed in 184us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599211.636745:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599211.636823:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249536:0@lo:101: 00010000:00010000:3.0:1787599211.636840:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599211.636849:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599211.636970:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249664:0@lo:501: 00000100:00100000:3.0:1787599211.637004:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599211.637495:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58c106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599211.637557:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543249664 00000100:00100000:2.0:1787599211.637564:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543249664 00000100:00100000:2.0:1787599211.637607:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787599211.637617:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6674:x1874433543249664:12345-0@lo:501: 00000100:00100000:2.0:1787599211.638023:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6674:x1874433543249664:12345-0@lo:501: Request processed in 407us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.638030:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599211.638111:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249664:0@lo:501: 00000100:00100000:3.0:1787599211.638501:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249792:0@lo:503: 00000100:00100000:1.0:1787599211.638617:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599211.638647:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58c106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599211.638688:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543249792 00000100:00100000:2.0:1787599211.638693:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543249792 00000100:00100000:2.0:1787599211.638730:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787599211.638737:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6674:x1874433543249792:12345-0@lo:503: 00000100:00100000:2.0:1787599211.638911:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6674:x1874433543249792:12345-0@lo:503: Request processed in 174us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.638918:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787599211.639049:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249792:0@lo:503: 00000040:00080000:3.0:1787599211.639848:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599211.639995:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249920:0@lo:502: 00000100:00100000:3.0:1787599211.640039:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599211.640061:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58c106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599211.640185:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543249920 00000100:00100000:2.0:1787599211.640190:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543249920 00000100:00100000:2.0:1787599211.640219:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787599211.640227:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6674:x1874433543249920:12345-0@lo:502: 00000100:00100000:2.0:1787599211.640544:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6674:x1874433543249920:12345-0@lo:502: Request processed in 316us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.640552:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787599211.640736:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543249920:0@lo:502: 00000040:00080000:3.0:1787599211.641082:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787599211.641145:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787599211.641206:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787599211.641250:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787599211.641287:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787599211.641332:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787599211.641368:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787599211.641812:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787599211.641864:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787599211.642725:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787599211.642765:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787599211.642827:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787599211.642975:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787599211.643012:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787599211.643063:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787599211.643114:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787599211.643310:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787599211.643360:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787599211.643476:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787599211.643511:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787599211.643558:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787599211.643604:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787599211.643643:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787599211.643691:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787599211.643727:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787599211.643757:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787599211.643803:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787599211.643837:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787599211.644366:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543250048:0@lo:502: 00000100:00100000:2.0:1787599211.644508:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.644583:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b442a96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599211.644641:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543250048 00000100:00100000:1.0:1787599211.644648:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543250048 00000100:00100000:1.0:1787599211.644717:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787599211.644726:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6674:x1874433543250048:12345-0@lo:502: 00000100:00100000:1.0:1787599211.644942:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6674:x1874433543250048:12345-0@lo:502: Request processed in 216us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599211.644950:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787599211.645034:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543250048:0@lo:502: 00000040:00080000:2.0:1787599211.645124:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787599211.645149:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787599211.645889:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787599211.645911:0:6700:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f6b44a73370) 00000020:00000080:2.0:1787599211.645930:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787599211.646010:0:6700:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6c50231800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787599211.646014:0:6700:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f6c50231800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787599211.646017:0:6700:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6c50231800 3 00010000:00080000:2.0:1787599211.646043:0:6700:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f6b44a79000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1787599211.648357:0:6700:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787599211.648983:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787599211.649017:0:6700:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787599211.649030:0:6700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa46cbc6741182401 00000100:00080000:2.0:1787599211.649044:0:6700:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599211.649049:0:6700:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f6b44a79000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787599211.649082:0:6700:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c76704000 x1874433543250176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599211.649121:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874433543250176:0@lo:38: 00000100:00100000:2.0:1787599211.649222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.649287:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543250176 00000100:00100000:2.0:1787599211.649293:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543250176 00000100:00100000:2.0:1787599211.649322:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599211.649330:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1874433543250176:12345-0@lo:38: 00010000:00080000:2.0:1787599211.649351:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1787599211.649578:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa46cbc6741182408 00000004:00100000:2.0:1787599211.649592:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787599211.649632:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9f6b44a7b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599211.649681:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874433543250176:12345-0@lo:38: Request processed in 350us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.649688:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787599211.649724:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f6c76704000 x1874433543250176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599211.649793:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787599211.649801:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787599211.649807:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787599211.649810:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787599211.649812:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6b44a79000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787599211.649818:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874433543250176:0@lo:38: 00000100:00080000:2.0:1787599211.649839:0:6700:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787599211.649912:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543250304:0@lo:400: 00000100:00100000:2.0:1787599211.649944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.649980:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543250304 00000100:00100000:2.0:1787599211.649984:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543250304 00000100:00100000:2.0:1787599211.650011:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599211.650018:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543250304:12345-0@lo:400: 00000100:00100000:2.0:1787599211.650054:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543250304:12345-0@lo:400: Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.650061:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787599211.650084:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f6c76704000 x1874433543250304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599211.650094:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543250304:0@lo:400: 00000040:00080000:2.0:1787599211.652442:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787599211.652898:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787599211.652923:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599211.652945:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.652957:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787599211.653002:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787599211.653004:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787599211.653005:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599211.653006:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599211.653008:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599211.653009:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599211.653011:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599211.653012:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787599211.653013:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787599211.653019:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599211.653020:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787599211.653024:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787599211.653026:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787599211.653027:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787599211.653028:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599211.653029:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599211.653030:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599211.653031:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599211.653032:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599211.653033:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787599211.653034:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787599211.653034:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599211.653035:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787599211.653058:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787599211.653076:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543250432:0@lo:253: 00000100:00100000:2.0:1787599211.653181:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.653217:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b442a9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599211.653748:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543250432 00000100:00100000:0.0:1787599211.653755:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543250432 00000100:00100000:0.0:1787599211.653802:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787599211.653811:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6674:x1874433543250432:12345-0@lo:253: 20000000:01000000:0.0:1787599211.653844:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787599211.653855:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787599211.694230:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787599211.694251:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787599211.694297:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787599211.694302:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787599211.694325:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.694344:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182360 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.694353:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.694452:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741182360 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.694466:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741182360 expref: 13 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599211.694498:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874433543250560:0@lo:104: 00000100:00100000:2.0:1787599211.694556:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599211.694714:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543250560 00000100:00100000:1.0:1787599211.694721:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543250560 00000100:00100000:1.0:1787599211.694759:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599211.694767:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5847:x1874433543250560:12345-0@lo:104: 00010000:00010000:1.0:1787599211.694779:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8a00/0xa46cbc6741182360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.694824:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599211.694829:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5847:x1874433543250560:12345-0@lo:104: Request processed in 64us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599211.694836:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787599211.694857:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599211.694878:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8a00/0xa46cbc6741182360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.694892:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c820f8a00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599211.694896:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8a00/0xa46cbc6741182360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.694904:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8a00/0xa46cbc6741182360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599211.694912:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8a00/0xa46cbc6741182360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599211.694918:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599211.694946:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8a00/0xa46cbc6741182360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.694953:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599211.694969:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8a00/0xa46cbc6741182360 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.694976:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8a00/0xa46cbc6741182360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599211.694992:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599211.694993:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599211.694995:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599211.695296:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b442a96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599211.695316:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874433543250560:0@lo:104: 00010000:00010000:2.0:1787599211.695336:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599211.699534:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599211.699563:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543250688:0@lo:103: 00000100:00100000:2.0:1787599211.699646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599211.699700:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543250688 00000100:00100000:2.0:1787599211.699707:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543250688 00010000:00010000:2.0:1787599211.699737:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182360 expref: 14 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599211.699764:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599211.699773:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58441c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:3299:x1874433543250688:12345-0@lo:103: 00010000:00010000:2.0:1787599211.699785:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599211.699791:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182360 expref: 14 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699803:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741182360 expref: 14 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699820:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741182360 expref: 14 pid: 5825 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699836:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699854:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787599211.699881:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005579604s 00010000:00010000:2.0:1787599211.699886:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699893:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699900:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699907:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699913:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599211.699917:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699924:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699938:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.699947:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599211.699983:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58441c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:3299:x1874433543250688:12345-0@lo:103: Request processed in 210us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599211.699990:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599211.700057:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543250688:0@lo:103: 00010000:00010000:2.0:1787599211.700080:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.700089:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599211.700095:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75619400/0xa46cbc674118240f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599211.700670:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:6674:x1874433543250432:12345-0@lo:253: Request processed in 46857us (47486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599211.700679:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599211.700752:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6674:1874433543250432:0@lo:253: 10000000:01000000:2.0:1787599211.700762:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787599211.700765:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787599211.700767:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787599211.700769:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599211.700770:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599211.700771:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599211.700773:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599211.700774:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599211.700776:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787599211.700777:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787599211.700778:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599211.700779:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787599211.700789:0:6674:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787599211.707148:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787599211.707362:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787599211.707684:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787599211.707835:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787599211.708356:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787599211.709354:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787599211.714968:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787599211.909613:0:6674:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787599211.909747:0:6674:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787599211.909791:0:6674:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787599211.909850:0:6674:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787599211.909945:0:6674:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787599211.909975:0:6674:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:0.0:1787599212.325497:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787599212.325505:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6c6dd51000 from 21 10000000:01000000:0.0:1787599212.325512:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787599212.325562:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.325574:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.325598:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599212.325625:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543250816:0@lo:101: 00000100:00100000:0.0:1787599212.325698:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599212.325759:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599212.326019:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543250816 00000100:00100000:1.0:1787599212.326039:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543250816 00000100:00100000:1.0:1787599212.326094:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787599212.326103:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5828:x1874433543250816:12345-0@lo:101: 00010000:00010000:1.0:1787599212.326117:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599212.326130:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c7d00fa00/0xa46cbc674118241d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.326426:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c7d00fa00/0xa46cbc674118241d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182416 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.326442:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c7d00fa00/0xa46cbc674118241d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182416 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.326453:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c7d00fa00, rc 0) 00000100:00100000:1.0:1787599212.326537:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543250816:12345-0@lo:101: Request processed in 435us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599212.326544:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787599212.326620:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543250816:0@lo:101: 00010000:00010000:0.0:1787599212.326634:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.326643:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599212.326697:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543250944:0@lo:501: 00000100:00100000:0.0:1787599212.326725:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599212.326796:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599212.326828:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543250944 00000100:00100000:1.0:1787599212.326832:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543250944 00000100:00100000:1.0:1787599212.327016:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787599212.327026:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543250944:12345-0@lo:501: 00000100:00100000:1.0:1787599212.327313:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543250944:12345-0@lo:501: Request processed in 288us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599212.327320:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787599212.327400:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543250944:0@lo:501: 00000100:00100000:0.0:1787599212.327438:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251072:0@lo:503: 00000100:00100000:0.0:1787599212.327478:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599212.327682:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599212.327743:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543251072 00000100:00100000:2.0:1787599212.327749:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543251072 00000100:00100000:2.0:1787599212.327776:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787599212.327783:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543251072:12345-0@lo:503: 00000100:00100000:2.0:1787599212.327997:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543251072:12345-0@lo:503: Request processed in 213us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599212.328004:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787599212.328431:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251072:0@lo:503: 00000100:00100000:3.0:1787599212.328801:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6723:1874433543251200:0@lo:502: 00000100:00100000:3.0:1787599212.328973:0:6723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599212.329046:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599212.329088:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543251200 00000100:00100000:2.0:1787599212.329094:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543251200 00000100:00100000:2.0:1787599212.329300:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787599212.329311:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6723:x1874433543251200:12345-0@lo:502: 00000100:00100000:2.0:1787599212.329513:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6723:x1874433543251200:12345-0@lo:502: Request processed in 203us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599212.329520:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787599212.329612:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6723:1874433543251200:0@lo:502: 00000100:00100000:0.0:1787599212.329660:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6723:1874433543251328:0@lo:502: 00000100:00100000:0.0:1787599212.329693:0:6723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599212.329866:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599212.330073:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543251328 00000100:00100000:1.0:1787599212.330079:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543251328 00000100:00100000:1.0:1787599212.330105:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787599212.330112:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6723:x1874433543251328:12345-0@lo:502: 00000100:00100000:1.0:1787599212.330298:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:6723:x1874433543251328:12345-0@lo:502: Request processed in 185us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599212.330311:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787599212.330484:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6723:1874433543251328:0@lo:502: 00000040:00080000:0.0:1787599212.330508:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787599212.330664:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787599212.330680:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787599212.330689:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.330701:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599212.330709:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787599212.330712:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f6c6dd51000 from 4 10000000:01000000:1.0:1787599212.330715:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787599212.330753:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.330761:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.330771:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599212.330784:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251456:0@lo:101: 00000100:00100000:1.0:1787599212.330815:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599212.330847:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643780 going to sleep for 11 seconds 00000100:00100000:0.0:1787599212.331011:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543251456 00000100:00100000:0.0:1787599212.331016:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543251456 00000100:00100000:0.0:1787599212.331040:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787599212.331047:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543251456:12345-0@lo:101: 00010000:00010000:0.0:1787599212.331056:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599212.331069:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40031c00/0xa46cbc674118242b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182424 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.331089:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40031c00/0xa46cbc674118242b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182424 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.331099:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40031c00/0xa46cbc674118242b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182424 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.331108:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031c00, rc 0) 00000100:00100000:0.0:1787599212.331146:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543251456:12345-0@lo:101: Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599212.331184:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787599212.331604:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251456:0@lo:101: 00010000:00010000:1.0:1787599212.331618:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.331627:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599212.331678:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251584:0@lo:256: 00000100:00100000:1.0:1787599212.331709:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599212.331740:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643780 going to sleep for 11 seconds 00000100:00100000:0.0:1787599212.331784:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543251584 00000100:00100000:0.0:1787599212.331788:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543251584 00000100:00100000:0.0:1787599212.331820:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787599212.331827:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543251584:12345-0@lo:256: 20000000:01000000:0.0:1787599212.331839:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787599212.331863:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787599212.331866:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787599212.332303:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543251584:12345-0@lo:256: Request processed in 474us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599212.332312:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787599212.332383:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251584:0@lo:256: 10000000:01000000:1.0:1787599212.332426:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787599212.332432:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.332441:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599212.332449:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787599212.332451:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787599212.332454:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787599212.332474:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.332483:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.332491:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599212.332504:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251712:0@lo:101: 00000100:00100000:1.0:1787599212.332531:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599212.332559:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599212.332617:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543251712 00000100:00100000:2.0:1787599212.332623:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543251712 00000100:00100000:2.0:1787599212.332656:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787599212.332663:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543251712:12345-0@lo:101: 00010000:00010000:2.0:1787599212.332672:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599212.332683:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182432 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599212.332699:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182432 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599212.332708:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182432 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599212.332728:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619200, rc 0) 00000100:00100000:2.0:1787599212.332769:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543251712:12345-0@lo:101: Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599212.332776:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599212.332889:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251712:0@lo:101: 00010000:00010000:1.0:1787599212.333025:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599212.333034:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599212.333081:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251840:0@lo:501: 00000100:00100000:1.0:1787599212.333107:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599212.333129:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599212.333190:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543251840 00000100:00100000:2.0:1787599212.333299:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543251840 00000100:00100000:2.0:1787599212.333331:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787599212.333338:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543251840:12345-0@lo:501: 00000100:00100000:2.0:1787599212.333599:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543251840:12345-0@lo:501: Request processed in 260us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599212.333606:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787599212.333717:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251840:0@lo:501: 00000100:00100000:1.0:1787599212.333746:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251968:0@lo:503: 00000100:00100000:1.0:1787599212.333784:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599212.333813:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599212.335331:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543251968 00000100:00100000:2.0:1787599212.335345:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543251968 00000100:00100000:2.0:1787599212.335403:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787599212.335411:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543251968:12345-0@lo:503: 00000100:00100000:2.0:1787599212.335690:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543251968:12345-0@lo:503: Request processed in 279us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599212.335698:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599212.335955:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543251968:0@lo:503: 00000100:00100000:1.0:1787599212.336761:0:6724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6724:1874433543252096:0@lo:502: 00000100:00100000:1.0:1787599212.336823:0:6724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599212.336912:0:6724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643840 going to sleep for 11 seconds 00000100:00100000:2.0:1787599212.337104:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543252096 00000100:00100000:2.0:1787599212.337111:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543252096 00000100:00100000:2.0:1787599212.337319:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787599212.337330:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:6724:x1874433543252096:12345-0@lo:502: 00000100:00100000:2.0:1787599212.337620:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:6724:x1874433543252096:12345-0@lo:502: Request processed in 291us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599212.337628:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599212.337709:0:6724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6724:1874433543252096:0@lo:502: 00000020:01000000:1.0:1787599212.337737:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599212.337745:0:6724:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787599212.337753:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599212.337755:0:6724:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787599212.337760:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787599212.337763:0:6724:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:1.0:1787599212.337783:0:6724:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787599212.337786:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599212.337803:0:6724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f6c7f7b99b8) 00000020:00000080:1.0:1787599212.337821:0:6724:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787599212.337825:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787599212.337918:0:6724:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787599212.337923:0:6724:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787599212.337929:0:6724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc6741182447 00010000:00080000:1.0:1787599212.337953:0:6724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f6c763f7800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1787599212.338179:0:6724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787599212.410715:0:6724:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787599212.410738:0:6724:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787599212.415186:0:6724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599212.415408:0:6724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599212.415456:0:6724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787599212.415511:0:6724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787599212.418350:0:6728:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599212.418358:0:6728:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787599212.418975:0:6724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599212.418993:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787599212.419027:0:6724:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787599212.419048:0:6724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa46cbc674118244e 00000100:00080000:2.0:1787599212.419059:0:6724:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599212.419064:0:6724:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f6c763f7800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787599212.419100:0:6724:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c76704000 x1874433543252224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599212.419135:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543252224:0@lo:8: 00000100:00100000:2.0:1787599212.419237:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787599212.419298:0:6724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787599212.419366:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599212.419370:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599212.419372:0:6724:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787599212.419375:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599212.419379:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599212.419381:0:6724:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787599212.419384:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599212.419385:0:6724:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787599212.419410:0:6724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6724:1874433543252352:0@lo:502: 00000100:00100000:2.0:1787599212.419451:0:6724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599212.419468:0:6724:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c43671780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599212.419488:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543252352 00000100:00100000:2.0:1787599212.419494:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543252352 00000100:00100000:2.0:1787599212.419537:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787599212.419547:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:6724:x1874433543252352:12345-0@lo:502: 00000100:00100000:1.0:1787599212.420075:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543252224 00000100:00100000:1.0:1787599212.420081:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543252224 00000100:00100000:1.0:1787599212.420103:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599212.420109:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1874433543252224:12345-0@lo:8: 00010000:00080000:1.0:1787599212.420130:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:1.0:1787599212.420153:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa46cbc6741182455 00002000:00100000:1.0:1787599212.420202:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f6c763f6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787599212.420207:0:6677:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787599212.420211:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787599212.420314:0:6677:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787599212.420453:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787599212.420479:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9f6c763f2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599212.420545:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1874433543252224:12345-0@lo:8: Request processed in 434us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599212.420561:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787599212.425037:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9f6c76704000 x1874433543252224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599212.425055:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787599212.425072:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787599212.425081:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787599212.425088:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787599212.425092:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c763f7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787599212.425116:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787599212.425123:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543252224:0@lo:8: 00000004:00080000:1.0:1787599212.427278:0:6728:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787599212.427365:0:6728:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 169801207853ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787599212.434255:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:6724:x1874433543252352:12345-0@lo:502: Request processed in 14700us (14794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599212.434269:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787599212.434330:0:6724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:6724:1874433543252352:0@lo:502: 00000020:01000000:2.0:1787599212.434363:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599212.434371:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599212.434374:0:6724:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787599212.434378:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787599212.436182:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787599212.436209:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787599212.436220:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.436233:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599212.436243:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787599212.436245:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f6c50f78000 from 1 10000000:01000000:0.0:1787599212.436248:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787599212.436287:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.436295:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.436305:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599212.436333:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543252480:0@lo:101: 00000100:00100000:0.0:1787599212.436390:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599212.436433:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5b3b9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599212.436572:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543252480 00000100:00100000:0.0:1787599212.436589:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543252480 00000100:00100000:0.0:1787599212.436631:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787599212.436641:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c5843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543252480:12345-0@lo:101: 00010000:00010000:0.0:1787599212.436655:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599212.436667:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741182463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118245c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.436690:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741182463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118245c expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.436701:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741182463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118245c expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.436711:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030a00, rc 0) 00000100:00100000:0.0:1787599212.436745:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c5843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543252480:12345-0@lo:101: Request processed in 105us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599212.436752:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787599212.436794:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543252480:0@lo:101: 00010000:00010000:0.0:1787599212.436807:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.436817:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599212.436883:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543252608:0@lo:501: 00000100:00100000:0.0:1787599212.436908:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599212.436922:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5b3b9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599212.436934:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543252608 00000100:00100000:0.0:1787599212.436937:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543252608 00000100:00100000:0.0:1787599212.436959:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787599212.436966:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543252608:12345-0@lo:501: 00000100:00100000:0.0:1787599212.437285:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543252608:12345-0@lo:501: Request processed in 318us (375us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599212.437292:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787599212.437321:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543252608:0@lo:501: 10000000:01000000:0.0:1787599212.437339:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787599212.437344:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599212.437351:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599212.500248:0:6729:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787599212.500280:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1874433543252864:0@lo:7: 00000100:00100000:1.0:1787599212.500347:0:6729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599212.500392:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b466430c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787599212.500409:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787599212.500439:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543252736:0@lo:13: 00000100:00100000:1.0:1787599212.500466:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599212.500501:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543252864 00000100:00100000:1.0:1787599212.500507:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543252864 00000100:00100000:1.0:1787599212.500558:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599212.500568:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6729:x1874433543252864:12345-0@lo:7: 00000100:00080000:2.0:1787599212.504212:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599212.504245:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543252736 00000100:00100000:2.0:1787599212.504255:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543252736 00000100:00100000:2.0:1787599212.504310:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599212.504321:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543252736:12345-0@lo:13: 00002000:00000024:2.0:1787599212.504345:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1787599212.504426:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543252736:12345-0@lo:13: Request processed in 107us (3959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599212.504433:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787599212.504542:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9f6c70138380 x1874433543252736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599212.504565:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543252736:0@lo:13: 00002000:00080000:1.0:1787599212.510752:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787599212.510761:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:0.0:1787599212.511004:0:6729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9f6c7013a300 x1874433543252864/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787599228 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599212.511021:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1874433543252864:0@lo:7: 00000004:00080000:0.0:1787599212.511033:0:6729:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787599212.511072:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1874433543252992:0@lo:5: 00000100:00100000:0.0:1787599212.511106:0:6729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599212.511152:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58427900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599212.511474:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6729:x1874433543252864:12345-0@lo:7: Request processed in 10904us (11124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599212.511483:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599212.511513:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543252992 00000100:00100000:1.0:1787599212.511519:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543252992 00000100:00100000:1.0:1787599212.511600:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599212.511609:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6729:x1874433543252992:12345-0@lo:5: 00002000:00080000:1.0:1787599212.511640:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787599212.511644:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787599212.511882:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6729:x1874433543252992:12345-0@lo:5: Request processed in 274us (775us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787599212.511890:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787599212.511948:0:6729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9f6c466ee680 x1874433543252992/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599228 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599212.511961:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1874433543252992:0@lo:5: 00000004:00080000:3.0:1787599212.511970:0:6729:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787599212.511996:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1874433543253120:0@lo:700: 00000100:00100000:3.0:1787599212.512022:0:6729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599212.512041:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683c180 going to sleep for 11 seconds 00010000:00010000:0.0:1787599212.516249:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599212.516361:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543253120 00000100:00100000:1.0:1787599212.516373:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543253120 00000100:00100000:1.0:1787599212.516437:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599212.516447:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6729:x1874433543253120:12345-0@lo:700: 00000100:00100000:1.0:1787599212.516507:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1874433543253248:0@lo:700: 00000100:00100000:1.0:1787599212.516569:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599212.516611:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599212.516631:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543253248 00000100:00100000:1.0:1787599212.516634:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543253248 00000100:00100000:1.0:1787599212.516665:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599212.516671:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1874433543253248:12345-0@lo:700: 00000100:00080000:1.0:1787599212.517327:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:2.0:1787599212.570990:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787599212.575714:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1874433543253248:12345-0@lo:700: Request processed in 59034us (59136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599212.575737:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787599212.575949:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c70138380 x1874433543253248/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787599228 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599212.575978:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1874433543253248:0@lo:700: 40000000:02000000:3.0:1787599212.575992:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1787599212.639567:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787599212.639597:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1787599212.639944:0:6729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c4fa0d880 x1874433543253120/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787599228 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599212.639957:0:6729:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787599212.639974:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1874433543253120:0@lo:700: 00000100:00100000:2.0:1787599212.640686:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6729:x1874433543253120:12345-0@lo:700: Request processed in 123398us (127818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599212.640704:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:02000040:0.0:1787599212.714257:0:6729:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787599212.716988:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1874433543253376:0@lo:5: 00000100:00100000:0.0:1787599212.717053:0:6729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599212.717260:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543253376 00000100:00100000:1.0:1787599212.717267:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543253376 00000100:00100000:1.0:1787599212.717319:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599212.717327:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6729:x1874433543253376:12345-0@lo:5: 00000100:00100000:0.0:1787599212.723891:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683c180 going to sleep for 11 seconds 00002000:00080000:1.0:1787599212.729043:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787599212.729065:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787599212.738490:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6729:x1874433543253376:12345-0@lo:5: Request processed in 21151us (21423us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787599212.738507:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787599212.741068:0:6729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c466ee680 x1874433543253376/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599228 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599212.741090:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1874433543253376:0@lo:5: 00000004:00080000:3.0:1787599212.741109:0:6729:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787599213.538615:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599214.562414:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599215.595292:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599216.618283:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599217.636130:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599217.699863:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543253760:0@lo:400: 00000100:00100000:2.0:1787599217.699935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599217.699987:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599217.699993:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543253632:0@lo:400: 00000100:00100000:2.0:1787599217.700022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599217.700057:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543253760 00000100:00100000:2.0:1787599217.700064:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543253760 00000100:00100000:2.0:1787599217.700105:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599217.700114:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543253760:12345-0@lo:400: 00000100:00100000:2.0:1787599217.700189:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543253760:12345-0@lo:400: Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599217.700196:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787599217.700234:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c76704000 x1874433543253760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599217.700345:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543253760:0@lo:400: 00000100:00100000:1.0:1787599217.700490:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543253504:0@lo:13: 00000100:00100000:1.0:1787599217.700534:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599217.700602:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543254016:0@lo:400: 00000100:00100000:1.0:1787599217.700625:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599217.700653:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599217.700659:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543253888:0@lo:400: 00000100:00100000:1.0:1787599217.700681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599217.701339:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543254016 00000100:00100000:3.0:1787599217.701346:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543254016 00000100:00100000:3.0:1787599217.701403:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599217.701411:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874433543254016:12345-0@lo:400: 00000100:00100000:3.0:1787599217.701461:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874433543254016:12345-0@lo:400: Request processed in 51us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599217.701468:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599217.701694:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543253632 00000100:00100000:0.0:1787599217.701699:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543253632 00000100:00100000:0.0:1787599217.701728:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787599217.701735:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3300:x1874433543253632:12345-0@lo:400: 00000100:00100000:0.0:1787599217.701777:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3300:x1874433543253632:12345-0@lo:400: Request processed in 43us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599217.701783:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787599217.701848:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543253632:0@lo:400: 00000100:00080000:1.0:1787599217.702407:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787599217.702437:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c76706a00 x1874433543254016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599217.702450:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543254016:0@lo:400: 00000100:00100000:2.0:1787599217.707112:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543253504 00000100:00100000:2.0:1787599217.707126:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543253504 00000100:00100000:2.0:1787599217.717288:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543253888 00000100:00100000:2.0:1787599217.717308:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543253888 00000100:00100000:2.0:1787599217.717381:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599217.717392:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543253888:12345-0@lo:400: 00000100:00100000:2.0:1787599217.718004:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543253888:12345-0@lo:400: Request processed in 612us (17320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599217.718038:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787599217.718067:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787599217.718069:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c76704380 x1874433543253888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599217.718085:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543253888:0@lo:400: 00000100:00100000:2.0:1787599217.718113:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599217.718120:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874433543253504:12345-0@lo:13: 00002000:00000024:2.0:1787599217.718153:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599217.718219:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874433543253504:12345-0@lo:13: Request processed in 99us (17684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599217.718226:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787599217.719458:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c4fa0d180 x1874433543253504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599217.719494:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543253504:0@lo:13: 00000001:00080000:0.0:1787599217.803708:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:3.0:1787599218.613499:0:7046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787599218.666647:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599219.684721:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599220.707373:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599221.729452:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599222.753316:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599222.827504:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543254144:0@lo:400: 00000100:00100000:3.0:1787599222.827576:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599222.827625:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599222.827632:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543254272:0@lo:400: 00000100:00100000:3.0:1787599222.827665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599222.827695:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543254400:0@lo:400: 00000100:00100000:3.0:1787599222.827717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599222.827735:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599222.827740:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543254528:0@lo:400: 00000100:00100000:3.0:1787599222.827764:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599222.827796:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543254144 00000100:00100000:3.0:1787599222.827803:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543254144 00000100:00100000:3.0:1787599222.827848:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787599222.827858:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3299:x1874433543254144:12345-0@lo:400: 00000100:00100000:3.0:1787599222.827905:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3299:x1874433543254144:12345-0@lo:400: Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599222.827912:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787599222.827944:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543254272 00000100:00100000:3.0:1787599222.827948:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543254272 00000100:00100000:3.0:1787599222.827987:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543254400 00000100:00100000:3.0:1787599222.827990:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543254400 00000100:00100000:3.0:1787599222.828015:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599222.828021:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543254272:12345-0@lo:400: 00000100:00100000:3.0:1787599222.828052:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543254272:12345-0@lo:400: Request processed in 32us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599222.828058:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599222.828082:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599222.828089:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543254400:12345-0@lo:400: 00000100:00100000:3.0:1787599222.828122:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543254400:12345-0@lo:400: Request processed in 33us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599222.828127:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599222.828149:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543254528 00000100:00100000:3.0:1787599222.828153:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543254528 00000100:00100000:3.0:1787599222.828207:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599222.828213:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543254528:12345-0@lo:400: 00000100:00100000:3.0:1787599222.828242:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543254528:12345-0@lo:400: Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599222.828248:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787599222.828286:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c4fa0ce00 x1874433543254272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599222.828299:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543254272:0@lo:400: 00000100:00100000:3.0:1787599222.828307:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543254144:0@lo:400: 00000100:00080000:3.0:1787599222.828331:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599222.828335:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787599222.828348:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c4fa0f100 x1874433543254528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599222.828356:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787599222.828366:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543254528:0@lo:400: 00010000:00080000:3.0:1787599222.828375:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c4fa0d500 x1874433543254400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599222.828394:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543254400:0@lo:400: 00000100:00100000:3.0:1787599222.828969:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543254656:0@lo:13: 00000100:00100000:3.0:1787599222.829003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599222.829130:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543254656 00000100:00100000:2.0:1787599222.829136:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543254656 00000100:00100000:2.0:1787599222.829193:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599222.829202:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543254656:12345-0@lo:13: 00002000:00000024:2.0:1787599222.829230:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599222.829268:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543254656:12345-0@lo:13: Request processed in 67us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599222.829274:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787599222.829779:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c76704000 x1874433543254656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599222.829796:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543254656:0@lo:13: 00010000:00010000:3.0:1787599223.779996:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599224.804239:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599225.825460:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599226.850650:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599227.876692:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599227.944850:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543255168:0@lo:400: 00000100:00100000:2.0:1787599227.944918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599227.944969:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599227.944975:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543254784:0@lo:400: 00000100:00100000:2.0:1787599227.944997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599227.945033:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543255168 00000100:00100000:2.0:1787599227.945040:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543255168 00000100:00100000:2.0:1787599227.945088:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599227.945099:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543255168:12345-0@lo:400: 00000100:00100000:2.0:1787599227.945143:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543255168:12345-0@lo:400: Request processed in 47us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599227.945190:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787599227.945210:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787599227.945235:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c466edc00 x1874433543255168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599227.945520:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543254784 00000100:00100000:0.0:1787599227.945525:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543254784 00000100:00100000:0.0:1787599227.945563:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787599227.945570:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3299:x1874433543254784:12345-0@lo:400: 00000100:00100000:0.0:1787599227.945608:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3299:x1874433543254784:12345-0@lo:400: Request processed in 40us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599227.945615:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787599227.945744:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543255168:0@lo:400: 00000100:00100000:2.0:1787599227.945769:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543254784:0@lo:400: 00000100:00100000:2.0:1787599227.946003:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543255040:0@lo:400: 00000100:00100000:2.0:1787599227.946037:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599227.946062:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599227.946069:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543254912:0@lo:400: 00000100:00100000:2.0:1787599227.946092:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599227.946121:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543255040 00000100:00100000:2.0:1787599227.946126:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543255040 00000100:00100000:2.0:1787599227.946186:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543254912 00000100:00100000:2.0:1787599227.946190:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543254912 00000100:00100000:2.0:1787599227.946207:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599227.946215:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543255040:12345-0@lo:400: 00000100:00100000:2.0:1787599227.946560:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543255040:12345-0@lo:400: Request processed in 344us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599227.946567:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599227.946585:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787599227.946593:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543254912:12345-0@lo:400: 00000100:00100000:2.0:1787599227.946625:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543254912:12345-0@lo:400: Request processed in 34us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599227.946631:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787599227.946671:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787599227.946694:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c466ec000 x1874433543254912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599227.946704:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543254912:0@lo:400: 00010000:00080000:2.0:1787599227.946714:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c466efb80 x1874433543255040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599227.946722:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543255040:0@lo:400: 00000100:00100000:1.0:1787599227.946895:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599227.946905:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543255296:0@lo:13: 00000100:00100000:1.0:1787599227.946934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599227.946966:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543255296 00000100:00100000:1.0:1787599227.946969:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543255296 00000100:00100000:1.0:1787599227.946995:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599227.947000:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543255296:12345-0@lo:13: 00002000:00000024:1.0:1787599227.947027:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599227.947064:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543255296:12345-0@lo:13: Request processed in 63us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599227.947069:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787599227.947095:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c70139500 x1874433543255296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599227.947109:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543255296:0@lo:13: 00010000:00010000:1.0:1787599228.897404:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599229.921427:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787599230.860799:0:7608:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787599230.860804:0:7608:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787599230.860947:0:7608:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f6b4432d000 00000020:01000004:0.0:1787599230.860964:0:7608:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787599230.860976:0:7608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787599230.860990:0:7608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f6c76708000) 00000020:00000080:0.0:1787599230.861005:0:7608:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787599230.874778:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787599230.875074:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787599230.895380:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787599230.900825:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787599230.900861:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787599230.900924:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787599230.900951:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787599230.901450:0:7608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787599230.901464:0:7608:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787599230.901474:0:7608:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa46cbc6741182471 00000020:01000004:0.0:1787599230.901482:0:7608:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787599230.901513:0:7608:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787599230.901516:0:7608:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787599230.901521:0:7608:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787599230.901663:0:7608:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787599230.901668:0:7608:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787599230.922742:0:7608:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787599230.922780:0:7608:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.130@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787599230.922787:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787599230.922789:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599230.922790:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599230.922791:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599230.922792:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599230.922794:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599230.922795:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599230.922796:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787599230.922798:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787599230.922799:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599230.922800:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787599230.922803:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787599230.922806:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599230.922807:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599230.922808:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599230.922809:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599230.922811:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599230.922812:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599230.922813:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599230.922814:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787599230.922815:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787599230.922816:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599230.922817:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787599230.922951:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787599230.922970:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543255424:0@lo:253: 00000100:00100000:0.0:1787599230.923034:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599230.923093:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599230.923371:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543255424 00000100:00100000:3.0:1787599230.923379:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543255424 00000100:00100000:3.0:1787599230.923426:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787599230.923435:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:7608:x1874433543255424:12345-0@lo:253: 20000000:01000000:3.0:1787599230.923463:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787599230.923467:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787599230.923472:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787599230.923476:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787599230.924476:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599230.924696:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787599230.924710:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787599230.924747:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787599230.924754:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787599230.924783:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787599230.924827:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787599230.925242:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787599230.925264:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.130@tcp 20000000:01000000:3.0:1787599230.925266:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:3.0:1787599230.925304:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787599230.925313:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787599230.925371:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787599230.925380:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:3.0:1787599230.925420:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787599230.925429:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787599230.925458:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787599230.925505:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787599230.926998:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787599230.927025:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.130@tcp 20000000:01000000:3.0:1787599230.927027:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.130@tcp (null) (null) (null) 00000040:00080000:3.0:1787599230.927071:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787599230.927079:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787599230.927118:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787599230.927125:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.130@tcp (null) (null) 00000040:00080000:3.0:1787599230.927361:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787599230.927372:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787599230.927422:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787599230.927485:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787599230.927505:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787599230.927508:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787599230.927515:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787599230.927516:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787599230.927518:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787599230.927531:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787599230.927534:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787599230.927572:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787599230.927575:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787599230.928810:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787599230.928979:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787599230.929016:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787599230.929593:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787599230.929714:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787599230.929773:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787599230.929786:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787599230.929788:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787599230.930885:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787599230.930947:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787599230.931001:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787599230.931338:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787599230.931380:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787599230.931436:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787599230.931450:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787599230.931452:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787599230.932067:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787599230.932385:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787599230.932422:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787599230.932501:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787599230.932517:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787599230.932519:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787599230.934060:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787599230.934136:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787599230.934405:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787599230.934966:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787599230.935014:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787599230.935049:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:1.0:1787599230.935067:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787599230.935086:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935104:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c7d00fe00/0xa46cbc67411823c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411823c2 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935113:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c7d00e400/0xa46cbc67411823f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411823ec expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935120:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c7d00fa00/0xa46cbc674118241d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182416 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935126:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182432 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935142:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741182463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118245c expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935150:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935406:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741182463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc674118245c expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935422:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741182463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc674118245c expref: 16 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599230.935437:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70139500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874433543255552:0@lo:104: 00000100:00100000:1.0:1787599230.935500:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599230.935587:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741182432 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935606:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741182432 expref: 16 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599230.935616:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874433543255680:0@lo:104: 00010000:00010000:1.0:1787599230.935640:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c7d00fa00/0xa46cbc674118241d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741182416 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935649:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c7d00fa00/0xa46cbc674118241d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741182416 expref: 16 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599230.935673:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874433543255808:0@lo:104: 00010000:00010000:1.0:1787599230.935717:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c7d00e400/0xa46cbc67411823f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411823ec expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935731:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c7d00e400/0xa46cbc67411823f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411823ec expref: 16 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599230.935740:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874433543255936:0@lo:104: 00010000:00010000:1.0:1787599230.935763:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c7d00fe00/0xa46cbc67411823c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411823c2 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.935772:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c7d00fe00/0xa46cbc67411823c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411823c2 expref: 16 pid: 5826 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599230.935780:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874433543256064:0@lo:104: 00000100:00100000:1.0:1787599230.935795:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c466d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1787599230.936538:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787599230.936565:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599230.936676:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599230.936729:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599230.936747:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543255552 00000100:00100000:1.0:1787599230.936755:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543255552 00000100:00100000:1.0:1787599230.936791:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543255680 00000100:00100000:1.0:1787599230.936794:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543255680 00000100:00100000:1.0:1787599230.936802:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543255808 00000100:00100000:1.0:1787599230.936805:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543255808 00000100:00100000:1.0:1787599230.936817:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599230.936825:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58435450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:5826:x1874433543255552:12345-0@lo:104: 00010000:00010000:1.0:1787599230.936951:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.937024:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599230.937030:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58435450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:5826:x1874433543255552:12345-0@lo:104: Request processed in 206us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599230.937039:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599230.937079:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787599230.937095:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:5826:x1874433543255680:12345-0@lo:104: 00010000:00010000:1.0:1787599230.937103:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.937139:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787599230.937144:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:5826:x1874433543255680:12345-0@lo:104: Request processed in 50us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599230.937150:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599230.937309:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70139500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874433543255552:0@lo:104: 00000100:00100000:0.0:1787599230.937319:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874433543255680:0@lo:104: 00010000:00010000:3.0:1787599230.937378:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599230.937386:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.937393:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031400 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599230.937396:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.937404:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599230.937411:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599230.937416:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599230.937454:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.937461:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599230.937480:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.937486:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118245c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182463 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.937500:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599230.937504:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.937509:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8e00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599230.937511:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.937525:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599230.937530:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599230.937535:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599230.937549:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.937555:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599230.937560:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.937566:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc6741182432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182439 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.937576:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599230.937578:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599230.937580:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599230.937733:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599230.937741:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5826:x1874433543255808:12345-0@lo:104: 00010000:00010000:1.0:1787599230.937750:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.937798:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599230.937804:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5826:x1874433543255808:12345-0@lo:104: Request processed in 65us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599230.937811:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787599230.937825:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599230.937830:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.937962:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599230.937965:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.937974:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599230.937981:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599230.937994:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599230.938015:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.938021:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599230.938035:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.938042:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c40030200/0xa46cbc6741182416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118241d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.938056:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599230.938058:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599230.938060:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599230.938072:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543256448:0@lo:103: 00000100:00100000:1.0:1787599230.938106:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599230.938147:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599230.938296:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874433543255808:0@lo:104: 00000100:00100000:2.0:1787599230.938481:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599230.938545:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543255936 00000100:00100000:1.0:1787599230.938551:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543255936 00000100:00100000:1.0:1787599230.938575:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543256064 00000100:00100000:1.0:1787599230.938578:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543256064 00000100:00100000:1.0:1787599230.938590:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599230.938671:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:5826:x1874433543255936:12345-0@lo:104: 00010000:00010000:1.0:1787599230.938681:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.938771:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599230.938778:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:5826:x1874433543255936:12345-0@lo:104: Request processed in 181us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599230.938791:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599230.938805:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599230.938812:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5826:x1874433543256064:12345-0@lo:104: 00010000:00010000:1.0:1787599230.938820:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.938870:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787599230.938876:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5826:x1874433543256064:12345-0@lo:104: Request processed in 65us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599230.938882:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787599230.938896:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599230.938900:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.938907:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599230.938910:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.938918:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599230.938926:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599230.938931:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599230.938952:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.938958:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599230.938973:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.938981:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411823ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411823f3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.938991:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599230.938994:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.939001:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599230.939004:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.939011:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599230.939018:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599230.939024:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599230.939035:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.939041:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599230.939045:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.939052:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c200/0xa46cbc67411823c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411823c9 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.939066:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599230.939071:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599230.939073:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599230.939082:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599230.939091:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543256576:0@lo:103: 00000100:00100000:1.0:1787599230.939119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599230.939364:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543256192:0@lo:103: 00000100:00100000:2.0:1787599230.939392:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599230.939420:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543256704:0@lo:103: 00000100:00100000:2.0:1787599230.939438:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599230.939449:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599230.939454:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543256320:0@lo:103: 00000100:00100000:2.0:1787599230.939472:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599230.939498:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543256448 00000100:00100000:2.0:1787599230.939503:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543256448 00010000:00010000:2.0:1787599230.939523:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c7d00fa00/0xa46cbc674118241d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182416 expref: 17 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599230.939536:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543256576 00000100:00100000:2.0:1787599230.939539:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543256576 00010000:00010000:2.0:1787599230.939550:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c7d00e400/0xa46cbc67411823f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411823ec expref: 18 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599230.939576:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543256192 00000100:00100000:2.0:1787599230.939579:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543256192 00010000:00010000:2.0:1787599230.939590:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741182463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118245c expref: 19 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599230.939680:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543256704 00000100:00100000:2.0:1787599230.939683:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543256704 00010000:00010000:2.0:1787599230.939697:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c7d00fe00/0xa46cbc67411823c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411823c2 expref: 20 pid: 5826 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599230.939707:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543256320 00000100:00100000:2.0:1787599230.939710:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543256320 00010000:00010000:2.0:1787599230.939719:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182432 expref: 21 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599230.939731:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599230.939738:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+21:3299:x1874433543256448:12345-0@lo:103: 00010000:00010000:2.0:1787599230.939748:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599230.939753:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c7d00fa00/0xa46cbc674118241d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182416 expref: 21 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.939763:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c7d00fa00/0xa46cbc674118241d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741182416 expref: 21 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.939777:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c7d00fa00/0xa46cbc674118241d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741182416 expref: 21 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.939794:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599230.939824:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+20:3299:x1874433543256448:12345-0@lo:103: Request processed in 86us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599230.939840:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599230.939922:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599230.939929:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543256576:12345-0@lo:103: 00010000:00010000:2.0:1787599230.939938:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599230.939942:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c7d00e400/0xa46cbc67411823f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411823ec expref: 19 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.939951:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c7d00e400/0xa46cbc67411823f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411823ec expref: 19 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.939961:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599230.939984:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543256576:12345-0@lo:103: Request processed in 55us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599230.939990:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599230.940001:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787599230.940007:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:3301:x1874433543256192:12345-0@lo:103: 00010000:00010000:2.0:1787599230.940013:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599230.940017:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741182463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118245c expref: 18 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940027:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741182463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc674118245c expref: 18 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940037:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741182463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc674118245c expref: 18 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940047:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599230.940071:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:3301:x1874433543256192:12345-0@lo:103: Request processed in 64us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599230.940083:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787599230.940094:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599230.940100:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3301:x1874433543256704:12345-0@lo:103: 00010000:00010000:2.0:1787599230.940108:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599230.940112:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c7d00fe00/0xa46cbc67411823c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411823c2 expref: 16 pid: 5826 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940121:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c7d00fe00/0xa46cbc67411823c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411823c2 expref: 16 pid: 5826 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940130:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599230.940150:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3301:x1874433543256704:12345-0@lo:103: Request processed in 50us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599230.940336:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599230.940350:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599230.940357:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:3301:x1874433543256320:12345-0@lo:103: 00010000:00010000:2.0:1787599230.940365:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599230.940370:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182432 expref: 15 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940379:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741182432 expref: 15 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940390:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741182432 expref: 15 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940401:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940419:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940434:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940442:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940449:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940456:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940461:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8c00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599230.940465:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940473:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940481:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.940491:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599230.940515:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:3301:x1874433543256320:12345-0@lo:103: Request processed in 158us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599230.940521:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599230.940558:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543256320:0@lo:103: 00000100:00100000:2.0:1787599230.940575:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543256192:0@lo:103: 00000100:00100000:2.0:1787599230.940583:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543256704:0@lo:103: 00010000:00010000:3.0:1787599230.940705:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599230.940770:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543256576:0@lo:103: 00000100:00100000:2.0:1787599230.940779:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543256448:0@lo:103: 00010000:00010000:0.0:1787599230.941062:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c7d00e400/0xa46cbc67411823f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411823ec expref: 13 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599230.941076:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874433543255936:0@lo:104: 00010000:00010000:0.0:1787599230.941086:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c7d00fe00/0xa46cbc67411823c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411823c2 expref: 12 pid: 5826 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599230.941094:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874433543256064:0@lo:104: 00010000:00010000:0.0:1787599230.941117:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599230.941127:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599230.941133:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599230.941140:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d8c00/0xa46cbc6741182478 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787599230.941152:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1787599230.950775:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599230.985038:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:7608:x1874433543255424:12345-0@lo:253: Request processed in 61595us (61995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599230.985051:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787599230.985152:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543255424:0@lo:253: 10000000:01000000:1.0:1787599230.985270:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787599230.985273:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787599230.985274:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787599230.985276:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599230.985277:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787599230.985279:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599230.985280:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599230.985282:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787599230.985284:0:7608:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787599230.985285:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599230.985287:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787599230.985307:0:7608:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f6b4432d000 from lustre-OST0001 10000000:01000000:1.0:1787599230.985332:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787599230.985335:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787599230.985342:0:7608:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f6c50f78000 local copy 10000000:01000000:1.0:1787599230.985347:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787599230.985385:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.985396:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.985406:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599230.985425:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543256832:0@lo:101: 00000100:00100000:1.0:1787599230.985463:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599230.985529:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c466d4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599230.985697:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543256832 00000100:00100000:2.0:1787599230.985703:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543256832 00000100:00100000:2.0:1787599230.985751:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787599230.985759:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:7608:x1874433543256832:12345-0@lo:101: 00010000:00010000:2.0:1787599230.985772:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599230.985785:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118247f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.985807:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118247f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.985817:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118247f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.985827:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619200, rc 0) 00000100:00100000:2.0:1787599230.985942:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543256832:12345-0@lo:101: Request processed in 183us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599230.985948:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787599230.986080:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543256832:0@lo:101: 00010000:00010000:3.0:1787599230.986094:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.986102:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599230.986361:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543256960:0@lo:501: 00000100:00100000:3.0:1787599230.986394:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599230.986419:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75faa540 going to sleep for 11 seconds 00000100:00100000:2.0:1787599230.986507:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543256960 00000100:00100000:2.0:1787599230.986518:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543256960 00000100:00100000:2.0:1787599230.986553:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599230.986560:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543256960:12345-0@lo:501: 00000100:00100000:2.0:1787599230.986969:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543256960:12345-0@lo:501: Request processed in 407us (571us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787599230.986977:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787599230.987404:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543256960:0@lo:501: 10000000:01000000:2.0:1787599230.987552:0:7608:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787599230.987586:0:7608:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787599230.987661:0:7608:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.987673:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.987680:0:7608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.987738:0:7608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787599230.987762:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f6b4432d000 10000000:01000000:2.0:1787599230.987767:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787599230.987773:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787599230.987775:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599230.987780:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787599230.987783:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787599230.987805:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.987814:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.987835:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599230.987910:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257088:0@lo:101: 00000100:00100000:2.0:1787599230.987947:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599230.988019:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086fa80 going to sleep for 11 seconds 00010000:00010000:3.0:1787599230.988058:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599230.988064:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.988071:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9a00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599230.988075:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.988084:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599230.988092:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599230.988098:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599230.988118:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.988124:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787599230.988276:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543257216:0@lo:103: 00000100:00100000:2.0:1787599230.988305:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599230.988345:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543257216 00000100:00100000:2.0:1787599230.988350:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543257216 00000100:00100000:2.0:1787599230.988391:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599230.988399:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3302:x1874433543257216:12345-0@lo:103: 00010000:00010000:2.0:1787599230.988410:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599230.988424:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75619200/0xa46cbc6741182486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc674118247f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599230.988442:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599230.988471:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:3302:x1874433543257216:12345-0@lo:103: Request processed in 73us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599230.988478:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599230.988521:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543257216:0@lo:103: 00010000:00010000:3.0:1787599230.988661:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.988670:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9a00/0xa46cbc674118247f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa46cbc6741182486 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.988681:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599230.988691:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599230.988694:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599230.988791:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543257088 00000100:00100000:1.0:1787599230.988796:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543257088 00000100:00100000:1.0:1787599230.988921:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787599230.988930:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+11:7608:x1874433543257088:12345-0@lo:101: 00010000:00010000:1.0:1787599230.988941:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599230.988955:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d8800/0xa46cbc6741182494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118248d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.988974:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d8800/0xa46cbc6741182494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118248d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.988984:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d8800/0xa46cbc6741182494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118248d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599230.988991:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8800, rc 0) 00000100:00100000:1.0:1787599230.989037:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543257088:12345-0@lo:101: Request processed in 109us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599230.989044:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787599230.989102:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257088:0@lo:101: 00010000:00010000:3.0:1787599230.989115:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599230.989145:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599230.989283:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257344:0@lo:501: 00000100:00100000:3.0:1787599230.989311:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599230.989731:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75faa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599230.989773:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543257344 00000100:00100000:2.0:1787599230.989778:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543257344 00000100:00100000:0.0:1787599230.989818:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787599230.989829:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543257344:12345-0@lo:501: 00000100:00100000:0.0:1787599230.990079:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543257344:12345-0@lo:501: Request processed in 252us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599230.990087:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787599230.990302:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257344:0@lo:501: 00000100:00100000:3.0:1787599230.990333:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257472:0@lo:503: 00000100:00100000:3.0:1787599230.990376:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599230.990393:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75faa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599230.990445:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543257472 00000100:00100000:0.0:1787599230.990450:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543257472 00000100:00100000:0.0:1787599230.990471:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787599230.990485:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543257472:12345-0@lo:503: 00000100:00100000:0.0:1787599230.990778:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543257472:12345-0@lo:503: Request processed in 293us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599230.990785:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787599230.990863:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257472:0@lo:503: 00000040:00080000:3.0:1787599230.991152:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599230.991364:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257600:0@lo:502: 00000100:00100000:3.0:1787599230.991400:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599230.991426:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75faa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599230.991489:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543257600 00000100:00100000:0.0:1787599230.991504:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543257600 00000100:00100000:0.0:1787599230.991526:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787599230.991533:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543257600:12345-0@lo:502: 00000100:00100000:0.0:1787599230.991688:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543257600:12345-0@lo:502: Request processed in 154us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599230.991696:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787599230.991875:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257600:0@lo:502: 00000040:00080000:3.0:1787599230.992118:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787599230.992215:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787599230.992266:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787599230.992315:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787599230.992351:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787599230.992399:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787599230.992425:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257728:0@lo:502: 00000100:00100000:3.0:1787599230.992463:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599230.992484:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75faa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599230.992777:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543257728 00000100:00100000:0.0:1787599230.992782:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543257728 00000100:00100000:0.0:1787599230.992808:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787599230.992815:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543257728:12345-0@lo:502: 00000100:00100000:0.0:1787599230.992974:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543257728:12345-0@lo:502: Request processed in 158us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599230.992982:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787599230.993268:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257728:0@lo:502: 00000040:00080000:3.0:1787599230.993374:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787599230.993383:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787599230.994061:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787599230.994070:0:7616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787599230.994077:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599230.994079:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787599230.994084:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599230.994099:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f6c48333370) 00000020:00000080:3.0:1787599230.994119:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787599230.994125:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787599230.994305:0:7616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6b4432d000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787599230.994313:0:7616:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787599230.994320:0:7616:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa46cbc67411824a2 00010000:00010000:3.0:1787599230.998752:0:7616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787599230.999455:0:7616:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787599231.003359:0:7616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787599231.003825:0:7616:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787599231.009625:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787599231.010124:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787599231.012371:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787599231.012383:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599231.012389:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599231.012392:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787599231.012396:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599231.012400:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599231.012401:0:7616:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787599231.012411:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787599231.012413:0:7616:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787599231.012486:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599231.012490:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599231.012500:0:7616:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787599231.012505:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787599231.014990:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787599231.015028:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787599231.015054:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599231.015068:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599231.015077:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6b4432d000 from 1 10000000:01000000:0.0:1787599231.015080:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599231.015124:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599231.015134:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599231.015145:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599231.015922:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257856:0@lo:101: 00000100:00100000:0.0:1787599231.015991:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599231.016041:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c708493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599231.016202:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543257856 00000100:00100000:1.0:1787599231.016210:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543257856 00000100:00100000:1.0:1787599231.016271:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787599231.016281:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:7608:x1874433543257856:12345-0@lo:101: 00010000:00010000:1.0:1787599231.016294:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599231.016305:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d8400/0xa46cbc67411824b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411824a9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599231.016328:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d8400/0xa46cbc67411824b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411824a9 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599231.016346:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d8400/0xa46cbc67411824b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411824a9 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599231.016355:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8400, rc 0) 00000100:00100000:1.0:1787599231.016402:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543257856:12345-0@lo:101: Request processed in 122us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599231.016409:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787599231.016746:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257856:0@lo:101: 00010000:00010000:2.0:1787599231.016762:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599231.016782:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599231.016887:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257984:0@lo:501: 00000100:00100000:2.0:1787599231.016917:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599231.016950:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599231.017001:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543257984 00000100:00100000:1.0:1787599231.017006:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543257984 00000100:00100000:1.0:1787599231.017028:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787599231.017035:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543257984:12345-0@lo:501: 00000100:00100000:1.0:1787599231.017306:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543257984:12345-0@lo:501: Request processed in 270us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599231.017314:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787599231.017457:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543257984:0@lo:501: 00000100:00100000:2.0:1787599231.017488:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258112:0@lo:503: 00000100:00100000:2.0:1787599231.017679:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599231.017706:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599231.017755:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543258112 00000100:00100000:0.0:1787599231.017760:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543258112 00000100:00100000:0.0:1787599231.017793:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787599231.017801:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543258112:12345-0@lo:503: 00000100:00100000:0.0:1787599231.018122:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543258112:12345-0@lo:503: Request processed in 321us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599231.018129:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787599231.018292:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258112:0@lo:503: 00000040:00080000:2.0:1787599231.018749:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787599231.018816:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258240:0@lo:502: 00000100:00100000:2.0:1787599231.018858:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599231.018891:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599231.018948:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543258240 00000100:00100000:0.0:1787599231.018953:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543258240 00000100:00100000:0.0:1787599231.019025:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787599231.019034:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543258240:12345-0@lo:502: 00000100:00100000:0.0:1787599231.019212:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543258240:12345-0@lo:502: Request processed in 180us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599231.019230:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787599231.019307:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258240:0@lo:502: 00000040:00080000:2.0:1787599231.019566:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787599231.019615:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787599231.019639:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258368:0@lo:502: 00000100:00100000:2.0:1787599231.019674:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599231.020315:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599231.020354:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543258368 00000100:00100000:1.0:1787599231.020360:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543258368 00000100:00100000:1.0:1787599231.020393:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787599231.020401:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543258368:12345-0@lo:502: 00000100:00100000:1.0:1787599231.020689:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543258368:12345-0@lo:502: Request processed in 289us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599231.020697:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787599231.020813:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258368:0@lo:502: 00000040:00080000:2.0:1787599231.020930:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787599231.020945:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787599231.021469:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599231.021479:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599231.021481:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787599231.021562:0:7620:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6b4432d000 00000020:00000080:0.0:1787599231.021565:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787599231.021591:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599231.021594:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599231.021596:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787599231.021598:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787599231.021751:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787599231.021775:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599231.021833:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599231.021845:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599231.021884:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787599231.021887:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f6b4432d000 10000000:01000000:2.0:1787599231.021890:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f6b4432d000 10000000:01000000:2.0:1787599231.021894:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599231.021900:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6b4432d000 from 1 10000000:01000000:2.0:1787599231.021903:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787599231.021935:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599231.021943:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599231.021954:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599231.021972:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258496:0@lo:101: 00000100:00100000:2.0:1787599231.022016:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599231.022052:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599231.022099:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543258496 00000100:00100000:0.0:1787599231.022104:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543258496 00000100:00100000:0.0:1787599231.022148:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787599231.022188:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543258496:12345-0@lo:101: 00010000:00010000:0.0:1787599231.022200:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599231.022212:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40031800/0xa46cbc67411824be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411824b7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599231.022243:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40031800/0xa46cbc67411824be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411824b7 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599231.022254:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40031800/0xa46cbc67411824be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411824b7 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599231.022264:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031800, rc 0) 00000100:00100000:0.0:1787599231.022310:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:7608:x1874433543258496:12345-0@lo:101: Request processed in 153us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599231.022317:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787599231.022355:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258496:0@lo:101: 00010000:00010000:0.0:1787599231.022368:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599231.022377:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599231.022759:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258624:0@lo:501: 00000100:00100000:0.0:1787599231.022791:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599231.022822:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599231.022863:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543258624 00000100:00100000:2.0:1787599231.022867:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543258624 00000100:00100000:2.0:1787599231.022902:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787599231.022910:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:7608:x1874433543258624:12345-0@lo:501: 00000100:00100000:2.0:1787599231.023121:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:7608:x1874433543258624:12345-0@lo:501: Request processed in 212us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599231.023128:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599231.023250:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258624:0@lo:501: 00000100:00100000:0.0:1787599231.023277:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258752:0@lo:503: 00000100:00100000:0.0:1787599231.023315:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599231.023340:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599231.023379:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543258752 00000100:00100000:2.0:1787599231.023383:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543258752 00000100:00100000:2.0:1787599231.023415:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787599231.023423:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:7608:x1874433543258752:12345-0@lo:503: 00000100:00100000:2.0:1787599231.023591:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:7608:x1874433543258752:12345-0@lo:503: Request processed in 169us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599231.023597:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787599231.023826:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258752:0@lo:503: 00000040:00080000:0.0:1787599231.024069:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599231.024123:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258880:0@lo:502: 00000100:00100000:0.0:1787599231.024193:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599231.024236:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849480 going to sleep for 11 seconds 00000100:00100000:2.0:1787599231.024291:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543258880 00000100:00100000:2.0:1787599231.024295:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543258880 00000100:00100000:2.0:1787599231.024358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787599231.024368:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:7608:x1874433543258880:12345-0@lo:502: 00000100:00100000:2.0:1787599231.024551:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:7608:x1874433543258880:12345-0@lo:502: Request processed in 186us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599231.024558:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787599231.024789:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543258880:0@lo:502: 00000040:00080000:0.0:1787599231.025031:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787599231.025073:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787599231.025099:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787599231.025145:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787599231.026028:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787599231.026105:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787599231.026137:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787599231.026185:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787599231.026254:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787599231.026292:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787599231.026316:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787599231.026351:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787599231.026377:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787599231.026400:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787599231.026435:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787599231.026461:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787599231.026485:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787599231.026838:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787599231.026881:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787599231.026906:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787599231.026943:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787599231.026974:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787599231.027064:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787599231.027105:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787599231.027132:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787599231.027233:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787599231.027283:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787599231.027311:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787599231.027335:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787599231.027509:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787599231.027768:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787599231.027889:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787599231.027925:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787599231.028092:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787599231.028131:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787599231.028211:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787599231.028687:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787599231.028737:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543259008:0@lo:502: 00000100:00100000:3.0:1787599231.029022:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599231.029064:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c45423780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599231.029070:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543259008 00000100:00100000:2.0:1787599231.029079:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543259008 00000100:00100000:2.0:1787599231.029137:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787599231.029147:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:7608:x1874433543259008:12345-0@lo:502: 00000100:00100000:2.0:1787599231.029412:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:7608:x1874433543259008:12345-0@lo:502: Request processed in 266us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599231.029420:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787599231.029622:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543259008:0@lo:502: 00000040:00080000:3.0:1787599231.029706:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787599231.029717:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787599231.030619:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787599231.030634:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f6c48334d28) 00000020:00000080:3.0:1787599231.030655:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787599231.030730:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6b4432d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787599231.030733:0:7621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f6b4432d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787599231.030736:0:7621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6b4432d000 3 00010000:00080000:3.0:1787599231.030761:0:7621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f6c76720000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1787599231.033231:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787599231.033435:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787599231.033470:0:7621:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787599231.033486:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa46cbc67411824cc 00000100:00080000:3.0:1787599231.034784:0:7621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599231.034794:0:7621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f6c76720000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787599231.034831:0:7621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c4fa0fb80 x1874433543259136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599231.034887:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874433543259136:0@lo:38: 00000100:00100000:2.0:1787599231.034958:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787599231.035033:0:7621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787599231.035095:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543259136 00000100:00100000:0.0:1787599231.035103:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543259136 00000100:00100000:0.0:1787599231.035143:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599231.035151:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1874433543259136:12345-0@lo:38: 00010000:00080000:0.0:1787599231.035189:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:0.0:1787599231.035236:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa46cbc67411824d3 00000004:00100000:0.0:1787599231.035253:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787599231.035290:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9f6c4fdcb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599231.035494:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874433543259136:12345-0@lo:38: Request processed in 341us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599231.035501:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787599231.035593:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c4fa0fb80 x1874433543259136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599231.035608:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599231.035616:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787599231.035622:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787599231.035625:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787599231.035627:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c76720000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787599231.035633:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874433543259136:0@lo:38: 00000100:00100000:1.0:1787599231.035797:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599231.035808:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543259520:0@lo:400: 00000100:00100000:1.0:1787599231.035839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599231.035870:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543259520 00000100:00100000:1.0:1787599231.035874:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543259520 00000100:00100000:1.0:1787599231.035922:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599231.035930:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543259520:12345-0@lo:400: 00000100:00100000:1.0:1787599231.035967:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543259520:12345-0@lo:400: Request processed in 39us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599231.035974:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787599231.035990:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787599231.036010:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c7013b480 x1874433543259520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599231.036020:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543259520:0@lo:400: 00000100:00100000:3.0:1787599231.036153:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543259264:0@lo:400: 00000100:00100000:3.0:1787599231.036202:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599231.036236:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599231.036242:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543259392:0@lo:400: 00000100:00100000:3.0:1787599231.036264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599231.036287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543259264 00000100:00100000:3.0:1787599231.036291:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543259264 00000100:00100000:3.0:1787599231.036313:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543259392 00000100:00100000:3.0:1787599231.036316:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543259392 00000100:00100000:3.0:1787599231.036342:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787599231.036349:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543259264:12345-0@lo:400: 00000100:00100000:3.0:1787599231.036383:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543259264:12345-0@lo:400: Request processed in 34us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599231.036389:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787599231.036403:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787599231.036410:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543259392:12345-0@lo:400: 00000100:00100000:3.0:1787599231.036437:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543259392:12345-0@lo:400: Request processed in 28us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599231.036442:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787599231.036476:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c7013a680 x1874433543259392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599231.036486:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543259392:0@lo:400: 00010000:00080000:3.0:1787599231.036570:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c7013aa00 x1874433543259264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599231.036579:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543259264:0@lo:400: 00000100:00080000:1.0:1787599231.036867:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599231.036912:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7623:1874433543259648:0@lo:901: 00000100:00100000:1.0:1787599231.036945:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599231.037005:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c466d4540 going to sleep for 11 seconds 00000040:00080000:1.0:1787599231.037104:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1787599231.037194:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787599231.037218:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787599231.037243:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.037254:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599231.037289:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543259648 00000100:00100000:0.0:1787599231.037294:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543259648 00000020:01000004:3.0:1787599231.037301:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787599231.037303:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787599231.037304:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599231.037306:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599231.037307:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599231.037308:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599231.037310:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599231.037312:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599231.037313:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599231.037315:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599231.037316:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599231.037320:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787599231.037323:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599231.037324:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787599231.037325:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599231.037326:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599231.037327:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599231.037328:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599231.037329:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599231.037335:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599231.037336:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599231.037336:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599231.037337:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599231.037349:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787599231.037357:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543259776:0@lo:253: 00000100:00100000:3.0:1787599231.037390:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599231.037580:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c45423180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599231.038299:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599231.038307:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7623:x1874433543259648:12345-0@lo:901: 00000100:00100000:0.0:1787599231.039435:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7623:x1874433543259648:12345-0@lo:901: Request processed in 1125us (2485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599231.039444:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787599231.039472:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787599231.039552:0:7623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c7013b480 x1874433543259648/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787599247 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599231.039567:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7623:1874433543259648:0@lo:901: 00000100:00100000:1.0:1787599231.040099:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543259776 00000100:00100000:1.0:1787599231.040107:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543259776 00000100:00100000:1.0:1787599231.040152:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787599231.040181:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:7608:x1874433543259776:12345-0@lo:253: 20000000:01000000:1.0:1787599231.040206:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787599231.040219:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787599231.064665:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787599231.064687:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787599231.064735:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787599231.064740:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787599231.064765:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.064784:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c40031c00/0xa46cbc674118242b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182424 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.064792:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.064834:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c40031c00/0xa46cbc674118242b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741182424 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.064849:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c40031c00/0xa46cbc674118242b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741182424 expref: 14 pid: 5826 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599231.064862:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874433543259904:0@lo:104: 00000100:00100000:3.0:1787599231.064932:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599231.064977:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7502bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599231.065713:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543259904 00000100:00100000:1.0:1787599231.065723:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543259904 00000100:00100000:1.0:1787599231.065783:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599231.065793:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5847:x1874433543259904:12345-0@lo:104: 00010000:00010000:1.0:1787599231.065808:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599231.065890:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599231.065897:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:5847:x1874433543259904:12345-0@lo:104: Request processed in 106us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599231.065904:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787599231.065985:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599231.065992:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066011:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599231.066015:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066023:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599231.066031:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599231.066037:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599231.066143:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066150:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599231.066190:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066197:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118242b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066215:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599231.066217:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599231.066230:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599231.066243:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543260032:0@lo:103: 00000100:00100000:3.0:1787599231.066280:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599231.066322:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543260032 00000100:00100000:3.0:1787599231.066326:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543260032 00010000:00010000:3.0:1787599231.066344:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c40031c00/0xa46cbc674118242b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182424 expref: 15 pid: 5826 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599231.066375:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599231.066381:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58442050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:3302:x1874433543260032:12345-0@lo:103: 00010000:00010000:3.0:1787599231.066393:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599231.066398:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c40031c00/0xa46cbc674118242b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182424 expref: 15 pid: 5826 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066409:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c40031c00/0xa46cbc674118242b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741182424 expref: 15 pid: 5826 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066425:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066433:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787599231.066447:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005579604s 00010000:00010000:3.0:1787599231.066451:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066458:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066464:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066470:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066475:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24ca00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599231.066479:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599231.066656:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c40031c00/0xa46cbc674118242b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741182424 expref: 15 pid: 5826 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599231.066668:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874433543259904:0@lo:104: 00010000:00010000:0.0:1787599231.066688:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599231.066697:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599231.066704:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066741:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066754:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066762:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24ca00/0xa46cbc67411824da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599231.066774:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599231.066811:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58442050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:3302:x1874433543260032:12345-0@lo:103: Request processed in 430us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599231.066819:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599231.066908:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543260032:0@lo:103: 00000100:00100000:1.0:1787599231.075653:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:7608:x1874433543259776:12345-0@lo:253: Request processed in 35465us (38253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599231.075667:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787599231.075794:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:7608:1874433543259776:0@lo:253: 10000000:01000000:3.0:1787599231.075810:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787599231.075813:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599231.075815:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787599231.075816:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599231.075818:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599231.075819:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599231.075820:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599231.075822:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599231.075823:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787599231.075824:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787599231.075826:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599231.075827:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787599231.075843:0:7608:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787599231.090828:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787599231.091006:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787599231.091887:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787599231.092152:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787599231.092426:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787599231.094059:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787599231.095793:0:7608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787599231.292883:0:7608:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787599231.292892:0:7608:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787599231.292924:0:7608:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787599231.292984:0:7608:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787599231.292998:0:7608:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787599231.293023:0:7608:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787599231.971525:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599232.993368:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599233.064068:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543260160:0@lo:13: 00000100:00100000:1.0:1787599233.064147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599233.064260:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543260160 00000100:00100000:1.0:1787599233.064270:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543260160 00000100:00100000:1.0:1787599233.064327:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599233.064338:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543260160:12345-0@lo:13: 00002000:00000024:1.0:1787599233.064946:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599233.065009:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543260160:12345-0@lo:13: Request processed in 672us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599233.065018:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787599233.065336:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c7013bb80 x1874433543260160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599233.065432:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543260160:0@lo:13: 00000100:00080000:0.0:1787599233.065558:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787599234.019110:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599235.042192:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599236.071142:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599236.130653:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543260416:0@lo:400: 00000100:00100000:0.0:1787599236.130727:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599236.130797:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599236.130803:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543260544:0@lo:400: 00000100:00100000:0.0:1787599236.130829:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599236.131083:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543260288:0@lo:400: 00000100:00100000:1.0:1787599236.131120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599236.131175:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543260800:0@lo:400: 00000100:00100000:1.0:1787599236.131198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599236.131217:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599236.131238:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543260672:0@lo:400: 00000100:00100000:1.0:1787599236.131264:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599236.131293:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543260288 00000100:00100000:1.0:1787599236.131302:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543260288 00000100:00100000:1.0:1787599236.131345:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787599236.131354:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:3300:x1874433543260288:12345-0@lo:400: 00000100:00100000:1.0:1787599236.131399:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:3300:x1874433543260288:12345-0@lo:400: Request processed in 46us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599236.131406:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787599236.131436:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543260672 00000100:00100000:1.0:1787599236.131440:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543260672 00000100:00100000:1.0:1787599236.131551:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599236.131559:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543260672:12345-0@lo:400: 00000100:00100000:1.0:1787599236.131591:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543260672:12345-0@lo:400: Request processed in 33us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599236.131596:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787599236.131634:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466ed180 x1874433543260672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599236.131649:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543260672:0@lo:400: 00000100:00100000:1.0:1787599236.131659:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543260288:0@lo:400: 00000100:00100000:0.0:1787599236.131884:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543260416 00000100:00100000:0.0:1787599236.131889:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543260416 00000100:00100000:0.0:1787599236.131912:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543260544 00000100:00100000:0.0:1787599236.131915:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543260544 00000100:00100000:0.0:1787599236.131929:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543260800 00000100:00100000:0.0:1787599236.132133:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543260800 00000100:00100000:0.0:1787599236.132722:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599236.132732:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543260416:12345-0@lo:400: 00000100:00100000:0.0:1787599236.132854:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543260416:12345-0@lo:400: Request processed in 125us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599236.132861:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599236.132879:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599236.132884:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543260544:12345-0@lo:400: 00000100:00100000:0.0:1787599236.132914:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543260544:12345-0@lo:400: Request processed in 30us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599236.132919:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599236.132942:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599236.133011:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543260800:12345-0@lo:400: 00000100:00100000:0.0:1787599236.133054:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543260800:12345-0@lo:400: Request processed in 103us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599236.133070:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787599236.133104:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599236.133108:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787599236.133142:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466efb80 x1874433543260800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599236.133154:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543260800:0@lo:400: 00010000:00080000:3.0:1787599236.138169:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466ee300 x1874433543260416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599236.138189:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543260416:0@lo:400: 00010000:00080000:3.0:1787599236.138224:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466ec380 x1874433543260544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599236.138234:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543260544:0@lo:400: 00000001:02000400:3.0:1787599236.582744:0:7964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787599237.090444:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599238.115620:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599238.177813:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599238.177843:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543260928:0@lo:13: 00000100:00100000:3.0:1787599238.177928:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599238.178610:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543260928 00000100:00100000:1.0:1787599238.178620:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543260928 00000100:00100000:1.0:1787599238.178700:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599238.178710:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543260928:12345-0@lo:13: 00002000:00000024:1.0:1787599238.178746:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599238.178815:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543260928:12345-0@lo:13: Request processed in 105us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599238.178822:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787599238.178955:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787599238.180215:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fa0c380 x1874433543260928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599238.180258:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543260928:0@lo:13: 00010000:00010000:2.0:1787599239.137866:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599240.163360:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787599240.225774:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787599240.225780:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6c50231800 from 30 10000000:01000000:2.0:1787599240.225786:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787599240.225827:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599240.225840:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599240.225851:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599240.225874:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261056:0@lo:101: 00000100:00100000:2.0:1787599240.225949:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599240.226006:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599240.226195:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543261056 00000100:00100000:1.0:1787599240.226203:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543261056 00000100:00100000:1.0:1787599240.226243:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787599240.226252:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543261056:12345-0@lo:101: 00010000:00010000:1.0:1787599240.226264:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599240.226276:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d9000/0xa46cbc67411824e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411824e1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.226299:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d9000/0xa46cbc67411824e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411824e1 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.226310:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d9000/0xa46cbc67411824e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411824e1 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.226320:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9000, rc 0) 00000100:00100000:1.0:1787599240.226369:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543261056:12345-0@lo:101: Request processed in 117us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.226376:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787599240.226392:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261056:0@lo:101: 00010000:00010000:3.0:1787599240.226410:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599240.226422:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599240.226591:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261184:0@lo:501: 00000100:00100000:2.0:1787599240.226615:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599240.226644:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599240.226688:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543261184 00000100:00100000:1.0:1787599240.226693:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543261184 00000100:00100000:1.0:1787599240.226722:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787599240.226729:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543261184:12345-0@lo:501: 00000100:00100000:1.0:1787599240.227069:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543261184:12345-0@lo:501: Request processed in 339us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.227075:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787599240.227184:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261184:0@lo:501: 00000100:00100000:2.0:1787599240.227219:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261312:0@lo:503: 00000100:00100000:2.0:1787599240.227265:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599240.227281:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599240.228766:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543261312 00000100:00100000:1.0:1787599240.228777:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543261312 00000100:00100000:1.0:1787599240.228824:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787599240.228833:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543261312:12345-0@lo:503: 00000100:00100000:1.0:1787599240.229689:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543261312:12345-0@lo:503: Request processed in 855us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.229699:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787599240.229721:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261312:0@lo:503: 00000100:00100000:2.0:1787599240.235709:0:8119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8119:1874433543261440:0@lo:502: 00000100:00100000:2.0:1787599240.235797:0:8119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599240.235843:0:8119:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599240.235856:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543261440 00000100:00100000:1.0:1787599240.235864:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543261440 00000100:00100000:1.0:1787599240.235916:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787599240.235926:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:8119:x1874433543261440:12345-0@lo:502: 00000100:00100000:1.0:1787599240.236405:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:8119:x1874433543261440:12345-0@lo:502: Request processed in 479us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.236413:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787599240.236563:0:8119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8119:1874433543261440:0@lo:502: 00000100:00100000:2.0:1787599240.236609:0:8119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8119:1874433543261568:0@lo:502: 00000100:00100000:2.0:1787599240.236644:0:8119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599240.236702:0:8119:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599240.236732:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543261568 00000100:00100000:1.0:1787599240.236736:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543261568 00000100:00100000:1.0:1787599240.236795:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787599240.236804:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:8119:x1874433543261568:12345-0@lo:502: 00000100:00100000:1.0:1787599240.236951:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:8119:x1874433543261568:12345-0@lo:502: Request processed in 148us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.236958:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787599240.237016:0:8119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8119:1874433543261568:0@lo:502: 00000040:00080000:2.0:1787599240.237035:0:8119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787599240.237781:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787599240.237796:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787599240.237805:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.237814:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599240.237820:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787599240.237822:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787599240.237824:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787599240.237846:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.237852:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.237858:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599240.237868:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261696:0@lo:101: 00000100:00100000:0.0:1787599240.237897:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.237933:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c45423e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599240.237946:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543261696 00000100:00100000:1.0:1787599240.237952:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543261696 00000100:00100000:1.0:1787599240.238021:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787599240.238029:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543261696:12345-0@lo:101: 00010000:00010000:1.0:1787599240.238039:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599240.238062:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411824f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411824ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.238093:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411824f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411824ef expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.238103:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411824f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411824ef expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.238113:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8c00, rc 0) 00000100:00100000:1.0:1787599240.238153:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543261696:12345-0@lo:101: Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.238190:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787599240.238257:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261696:0@lo:101: 00010000:00010000:0.0:1787599240.238271:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.238280:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599240.238325:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261824:0@lo:501: 00000100:00100000:0.0:1787599240.238349:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.238810:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c45423e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599240.238903:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543261824 00000100:00100000:1.0:1787599240.238907:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543261824 00000100:00100000:1.0:1787599240.238945:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787599240.238953:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543261824:12345-0@lo:501: 00000100:00100000:1.0:1787599240.239266:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543261824:12345-0@lo:501: Request processed in 313us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.239273:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787599240.239488:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261824:0@lo:501: 00000100:00100000:0.0:1787599240.239523:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261952:0@lo:503: 00000100:00100000:0.0:1787599240.239563:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.239593:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c45423e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.240094:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543261952 00000100:00100000:3.0:1787599240.240100:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543261952 00000100:00100000:3.0:1787599240.240183:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787599240.240192:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543261952:12345-0@lo:503: 00000100:00100000:3.0:1787599240.240914:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543261952:12345-0@lo:503: Request processed in 722us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.240922:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787599240.241216:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543261952:0@lo:503: 00000100:00100000:1.0:1787599240.242093:0:8120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70139f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8120:1874433543262080:0@lo:502: 00000100:00100000:1.0:1787599240.242149:0:8120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599240.242197:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543262080 00000100:00100000:3.0:1787599240.242203:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543262080 00000100:00100000:1.0:1787599240.242204:0:8120:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.242249:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787599240.242258:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:8120:x1874433543262080:12345-0@lo:502: 00000100:00100000:3.0:1787599240.242544:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:8120:x1874433543262080:12345-0@lo:502: Request processed in 287us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.242553:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787599240.242597:0:8120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70139f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8120:1874433543262080:0@lo:502: 00000020:01000000:3.0:1787599240.242622:0:8120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599240.242632:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599240.242634:0:8120:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787599240.242714:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787599240.242717:0:8120:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787599240.242735:0:8120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8120:1874433543262208:0@lo:502: 00000100:00100000:3.0:1787599240.242769:0:8120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599240.242793:0:8120:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c81f59180 going to sleep for 11 seconds 00000100:00100000:1.0:1787599240.243028:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543262208 00000100:00100000:1.0:1787599240.243033:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543262208 00000100:00100000:1.0:1787599240.243076:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787599240.243084:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:8120:x1874433543262208:12345-0@lo:502: 00000100:00100000:1.0:1787599240.243250:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:8120:x1874433543262208:12345-0@lo:502: Request processed in 166us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.243265:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787599240.243303:0:8120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8120:1874433543262208:0@lo:502: 00000020:01000000:3.0:1787599240.243322:0:8120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599240.243331:0:8120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599240.243333:0:8120:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787599240.243337:0:8120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787599240.243522:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787599240.243540:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787599240.243552:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.243565:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599240.243575:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787599240.243577:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6c6dd51000 from 30 10000000:01000000:1.0:1787599240.243581:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787599240.243607:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.243615:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.243624:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599240.243637:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543262336:0@lo:101: 00000100:00100000:1.0:1787599240.243666:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599240.243833:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.244862:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543262336 00000100:00100000:3.0:1787599240.244870:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543262336 00000100:00100000:0.0:1787599240.245095:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787599240.245107:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543262336:12345-0@lo:101: 00010000:00010000:0.0:1787599240.245120:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599240.245134:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40030200/0xa46cbc6741182504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411824fd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.245172:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40030200/0xa46cbc6741182504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411824fd expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.245183:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40030200/0xa46cbc6741182504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411824fd expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.245192:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030200, rc 0) 00000100:00100000:0.0:1787599240.245265:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543262336:12345-0@lo:101: Request processed in 161us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599240.245272:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787599240.245316:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543262336:0@lo:101: 00010000:00010000:0.0:1787599240.245331:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.245340:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599240.245391:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543262464:0@lo:501: 00000100:00100000:0.0:1787599240.245419:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.245449:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c45423e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.245461:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543262464 00000100:00100000:3.0:1787599240.245465:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543262464 00000100:00100000:3.0:1787599240.245494:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787599240.245502:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543262464:12345-0@lo:501: 00000100:00100000:3.0:1787599240.245864:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543262464:12345-0@lo:501: Request processed in 361us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.245871:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787599240.245915:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543262464:0@lo:501: 00000100:00100000:0.0:1787599240.246090:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543262592:0@lo:503: 00000100:00100000:0.0:1787599240.246124:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.246197:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c45423e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.246304:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543262592 00000100:00100000:3.0:1787599240.246308:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543262592 00000100:00100000:3.0:1787599240.246366:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787599240.246374:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543262592:12345-0@lo:503: 00000100:00100000:3.0:1787599240.246590:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543262592:12345-0@lo:503: Request processed in 216us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.246597:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787599240.246660:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543262592:0@lo:503: 00000100:00100000:1.0:1787599240.247350:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8122:1874433543262720:0@lo:502: 00000100:00100000:1.0:1787599240.247454:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599240.247513:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.247549:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543262720 00000100:00100000:3.0:1787599240.247554:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543262720 00000100:00100000:3.0:1787599240.247611:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787599240.247620:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:8122:x1874433543262720:12345-0@lo:502: 00000100:00100000:3.0:1787599240.247812:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:8122:x1874433543262720:12345-0@lo:502: Request processed in 192us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.247819:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787599240.247881:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8122:1874433543262720:0@lo:502: 00000100:00100000:1.0:1787599240.247920:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8122:1874433543262848:0@lo:502: 00000100:00100000:1.0:1787599240.247962:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599240.248335:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599240.248363:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543262848 00000100:00100000:0.0:1787599240.248368:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543262848 00000100:00100000:0.0:1787599240.248461:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787599240.248470:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:8122:x1874433543262848:12345-0@lo:502: 00000100:00100000:0.0:1787599240.248629:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:8122:x1874433543262848:12345-0@lo:502: Request processed in 160us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.248717:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8122:1874433543262848:0@lo:502: 00000040:00080000:1.0:1787599240.248740:0:8122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:0.0:1787599240.248864:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000020:01000000:0.0:1787599240.248909:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787599240.248925:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787599240.249069:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.249086:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599240.249096:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787599240.249098:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f6c6dd51000 from 5 10000000:01000000:0.0:1787599240.249101:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787599240.249129:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.249137:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.249146:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599240.249321:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543262976:0@lo:101: 00000100:00100000:0.0:1787599240.249355:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.249485:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c45423840 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.249533:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543262976 00000100:00100000:3.0:1787599240.249537:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543262976 00000100:00100000:1.0:1787599240.249579:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787599240.249586:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543262976:12345-0@lo:101: 00010000:00010000:1.0:1787599240.249596:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599240.249607:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d9a00/0xa46cbc6741182512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118250b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.249624:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d9a00/0xa46cbc6741182512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118250b expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.249632:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d9a00/0xa46cbc6741182512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118250b expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.249707:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9a00, rc 0) 00000100:00100000:1.0:1787599240.249778:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543262976:12345-0@lo:101: Request processed in 192us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.249784:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787599240.249922:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543262976:0@lo:101: 00010000:00010000:0.0:1787599240.250150:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.250225:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599240.250339:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543263104:0@lo:256: 00000100:00100000:0.0:1787599240.250375:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.250477:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c45423840 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.250591:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543263104 00000100:00100000:3.0:1787599240.250602:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543263104 00000100:00100000:3.0:1787599240.250725:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787599240.250735:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543263104:12345-0@lo:256: 20000000:01000000:3.0:1787599240.250755:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787599240.250770:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787599240.250773:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787599240.250851:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543263104:12345-0@lo:256: Request processed in 117us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599240.250896:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543263104:0@lo:256: 10000000:01000000:0.0:1787599240.250936:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787599240.250942:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.250950:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599240.250957:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787599240.250959:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787599240.250962:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787599240.250980:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.250987:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.251072:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599240.251086:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543263232:0@lo:101: 00000100:00100000:0.0:1787599240.251110:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.251129:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4517dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.251180:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787599240.251201:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543263232 00000100:00100000:3.0:1787599240.251205:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543263232 00000100:00100000:3.0:1787599240.251224:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787599240.251230:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543263232:12345-0@lo:101: 00010000:00010000:3.0:1787599240.251328:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599240.251339:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182519 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599240.251355:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182519 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599240.251363:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182519 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599240.251371:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24dc00, rc 0) 00000100:00100000:3.0:1787599240.251472:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543263232:12345-0@lo:101: Request processed in 241us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.251478:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787599240.251725:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543263232:0@lo:101: 00010000:00010000:0.0:1787599240.251738:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.251747:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599240.251802:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543263360:0@lo:501: 00000100:00100000:0.0:1787599240.251828:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.251850:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4517dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599240.251862:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543263360 00000100:00100000:0.0:1787599240.251865:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543263360 00000100:00100000:0.0:1787599240.251888:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599240.251895:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543263360:12345-0@lo:501: 00000100:00100000:0.0:1787599240.252781:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543263360:12345-0@lo:501: Request processed in 884us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599240.252789:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599240.252833:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543263360:0@lo:501: 00000100:00100000:0.0:1787599240.252867:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543263488:0@lo:503: 00000100:00100000:0.0:1787599240.252906:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.252922:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4517dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599240.252935:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543263488 00000100:00100000:0.0:1787599240.252940:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543263488 00000100:00100000:0.0:1787599240.252966:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787599240.252973:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543263488:12345-0@lo:503: 00000100:00100000:0.0:1787599240.254494:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543263488:12345-0@lo:503: Request processed in 1514us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599240.254504:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787599240.254610:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543263488:0@lo:503: 00000100:00100000:1.0:1787599240.255197:0:8124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8124:1874433543263616:0@lo:502: 00000100:00100000:1.0:1787599240.255246:0:8124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599240.255274:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543263616 00000100:00100000:1.0:1787599240.255284:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543263616 00000100:00100000:1.0:1787599240.255318:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787599240.255326:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8124:x1874433543263616:12345-0@lo:502: 00000100:00100000:1.0:1787599240.255580:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8124:x1874433543263616:12345-0@lo:502: Request processed in 254us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.255588:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787599240.255627:0:8124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599240.255643:0:8124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8124:1874433543263616:0@lo:502: 00000020:01000000:1.0:1787599240.255669:0:8124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599240.255677:0:8124:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787599240.256063:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599240.256066:0:8124:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787599240.256072:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787599240.256075:0:8124:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:1.0:1787599240.256096:0:8124:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787599240.256099:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599240.256114:0:8124:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f6c7f7bb370) 00000020:00000080:1.0:1787599240.256135:0:8124:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787599240.256140:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787599240.258402:0:8124:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787599240.258412:0:8124:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787599240.258424:0:8124:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc674118252e 00010000:00080000:1.0:1787599240.258460:0:8124:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f6b4664e800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1787599240.258672:0:8124:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787599240.259124:0:8124:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787599240.259137:0:8124:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787599240.260474:0:8124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599240.260788:0:8124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599240.260842:0:8124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787599240.260901:0:8124:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787599240.261478:0:8125:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599240.261483:0:8125:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787599240.262481:0:8124:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599240.262494:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787599240.262525:0:8124:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787599240.262547:0:8124:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa46cbc6741182535 00000100:00080000:1.0:1787599240.262556:0:8124:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599240.262562:0:8124:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f6b4664e800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1787599240.262594:0:8124:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c7013aa00 x1874433543263744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599240.262900:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543263744:0@lo:8: 00000100:00100000:3.0:1787599240.263020:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.263125:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543263744 00000100:00100000:0.0:1787599240.263132:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543263744 00000100:00100000:0.0:1787599240.263177:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599240.263184:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3298:x1874433543263744:12345-0@lo:8: 00010000:00080000:0.0:1787599240.263210:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:0.0:1787599240.263236:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa46cbc674118253c 00002000:00100000:0.0:1787599240.263249:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f6c76629000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787599240.263253:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787599240.263257:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787599240.263391:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787599240.263552:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787599240.263573:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662c800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787599240.263608:0:8124:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787599240.263666:0:8124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599240.263672:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599240.263674:0:8124:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000100:00100000:0.0:1787599240.263798:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1874433543263744:12345-0@lo:8: Request processed in 612us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599240.263805:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787599240.263809:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c7013aa00 x1874433543263744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599240.263819:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599240.263827:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787599240.263833:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787599240.263837:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787599240.263839:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6b4664e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000020:01000000:1.0:1787599240.263854:0:8124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599240.263861:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599240.263862:0:8124:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000004:00080000:3.0:1787599240.263863:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000020:00000080:1.0:1787599240.263866:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000100:00100000:3.0:1787599240.263868:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543263744:0@lo:8: 00000020:00000080:1.0:1787599240.263868:0:8124:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787599240.263894:0:8124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8124:1874433543263872:0@lo:502: 00000100:00100000:1.0:1787599240.263940:0:8124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599240.263944:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543264000:0@lo:400: 00000100:00100000:3.0:1787599240.263969:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599240.263991:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:2.0:1787599240.264093:0:8125:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787599240.264213:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543263872 00000100:00100000:0.0:1787599240.264218:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543263872 00000100:00100000:0.0:1787599240.264248:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787599240.264255:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8124:x1874433543263872:12345-0@lo:502: 00000100:00100000:3.0:1787599240.264316:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543264384:0@lo:400: 00000100:00100000:3.0:1787599240.264340:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599240.264368:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543264128:0@lo:400: 00000100:00100000:3.0:1787599240.264389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599240.264405:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599240.264410:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543264256:0@lo:400: 00000100:00100000:3.0:1787599240.264429:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.264453:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8124:x1874433543263872:12345-0@lo:502: Request processed in 198us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.264454:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543264000 00000100:00100000:3.0:1787599240.264457:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543264000 00000100:00100000:0.0:1787599240.264460:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787599240.264477:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543264384 00000100:00100000:3.0:1787599240.264479:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543264384 00000100:00100000:3.0:1787599240.264498:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543264128 00000100:00100000:3.0:1787599240.264500:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543264128 00000100:00100000:3.0:1787599240.264512:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787599240.264518:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543264000:12345-0@lo:400: 00000100:00100000:3.0:1787599240.264552:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543264000:12345-0@lo:400: Request processed in 34us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.264564:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787599240.264576:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599240.264583:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543264384:12345-0@lo:400: 00000100:00100000:3.0:1787599240.264610:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543264384:12345-0@lo:400: Request processed in 28us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.264612:0:8124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4646f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.264615:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599240.264624:0:8124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8124:1874433543263872:0@lo:502: 00000100:00100000:3.0:1787599240.264625:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787599240.264630:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543264128:12345-0@lo:400: 00000020:01000000:1.0:1787599240.264645:0:8124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599240.264650:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599240.264651:0:8124:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787599240.264655:0:8124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:2.0:1787599240.264707:0:8125:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 197638549333ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787599240.264777:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543264128:12345-0@lo:400: Request processed in 146us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.264783:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787599240.264813:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543264256 00000100:00100000:3.0:1787599240.264817:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543264256 00000020:01000000:0.0:1787599240.264927:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787599240.264945:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787599240.264953:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.264965:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599240.264974:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787599240.264982:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f6c50f78000 from 1 10000000:01000000:0.0:1787599240.264985:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787599240.265011:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.265018:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.265026:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599240.265039:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543264512:0@lo:101: 00000100:00100000:0.0:1787599240.265077:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.265132:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4819d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599240.265145:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599240.265153:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543264256:12345-0@lo:400: 00000100:00100000:1.0:1787599240.265225:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543264512 00000100:00100000:1.0:1787599240.265229:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543264512 00000100:00100000:1.0:1787599240.265252:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787599240.265265:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543264512:12345-0@lo:101: 00010000:00010000:1.0:1787599240.265275:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599240.265284:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d9200/0xa46cbc674118254a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182543 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.265303:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d9200/0xa46cbc674118254a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182543 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.265313:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d9200/0xa46cbc674118254a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182543 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599240.265322:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9200, rc 0) 00000100:00100000:1.0:1787599240.265361:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543264512:12345-0@lo:101: Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599240.265367:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787599240.265386:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543264512:0@lo:101: 00010000:00010000:2.0:1787599240.265398:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599240.265406:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599240.265449:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543264640:0@lo:501: 00000100:00100000:2.0:1787599240.265480:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599240.265501:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91900 going to sleep for 11 seconds 00000100:00100000:0.0:1787599240.265526:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543264640 00000100:00100000:0.0:1787599240.265530:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543264640 00000100:00080000:3.0:1787599240.265541:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599240.265545:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599240.265590:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787599240.265599:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543264640:12345-0@lo:501: 00000100:00100000:0.0:1787599240.265778:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543264640:12345-0@lo:501: Request processed in 180us (296us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599240.265784:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787599240.265900:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543264640:0@lo:501: 10000000:01000000:0.0:1787599240.265922:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787599240.265928:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599240.265934:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787599240.271584:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fa0c000 x1874433543264128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599240.271604:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543264128:0@lo:400: 00010000:00080000:3.0:1787599240.271638:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fa0f100 x1874433543264384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599240.271648:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543264384:0@lo:400: 00010000:00080000:3.0:1787599240.271659:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fa0df80 x1874433543264000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599240.271684:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543264000:0@lo:400: 00000100:00100000:3.0:1787599240.271782:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543264256:12345-0@lo:400: Request processed in 6630us (7351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.271792:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787599240.271828:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fa0ce00 x1874433543264256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599240.271836:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543264256:0@lo:400: 00000004:00080000:1.0:1787599240.322087:0:8126:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787599240.322119:0:8126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8126:1874433543264896:0@lo:7: 00000100:00100000:1.0:1787599240.322217:0:8126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.322262:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543264896 00000100:00100000:1.0:1787599240.322266:0:8126:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599240.322270:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543264896 00000100:00100000:0.0:1787599240.322335:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599240.322344:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8126:x1874433543264896:12345-0@lo:7: 00000100:00080000:1.0:1787599240.322465:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787599240.323197:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787599240.323228:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543264768:0@lo:13: 00000100:00100000:3.0:1787599240.323267:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599240.323331:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543264768 00000100:00100000:3.0:1787599240.323336:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543264768 00000100:00100000:3.0:1787599240.323367:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599240.323374:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874433543264768:12345-0@lo:13: 00002000:00000024:3.0:1787599240.323394:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787599240.323437:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874433543264768:12345-0@lo:13: Request processed in 63us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.323445:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787599240.323484:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c7013a680 x1874433543264768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599240.323505:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543264768:0@lo:13: 00002000:00080000:0.0:1787599240.327405:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787599240.327414:0:6677:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787599240.327510:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8126:x1874433543264896:12345-0@lo:7: Request processed in 5163us (5289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599240.327521:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787599240.328267:0:8126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c70138380 x1874433543264896/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787599256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599240.328282:0:8126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8126:1874433543264896:0@lo:7: 00000004:00080000:1.0:1787599240.328297:0:8126:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787599240.328337:0:8126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8126:1874433543265024:0@lo:5: 00000100:00100000:1.0:1787599240.328369:0:8126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599240.328408:0:8126:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599240.328411:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543265024 00000100:00100000:0.0:1787599240.328418:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543265024 00000100:00100000:0.0:1787599240.328465:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599240.328474:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8126:x1874433543265024:12345-0@lo:5: 00002000:00080000:0.0:1787599240.328500:0:6679:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787599240.328503:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787599240.329242:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8126:x1874433543265024:12345-0@lo:5: Request processed in 768us (870us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787599240.329251:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787599240.331505:0:8126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c70138380 x1874433543265024/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599240.331524:0:8126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8126:1874433543265024:0@lo:5: 00000004:00080000:1.0:1787599240.331537:0:8126:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787599240.331574:0:8126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70139f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8126:1874433543265152:0@lo:700: 00000100:00100000:1.0:1787599240.331618:0:8126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599240.331665:0:8126:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4683ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599240.331826:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543265152 00000100:00100000:2.0:1787599240.331833:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543265152 00000100:00100000:2.0:1787599240.331880:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599240.331889:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8126:x1874433543265152:12345-0@lo:700: 00000100:00100000:2.0:1787599240.331921:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1874433543265280:0@lo:700: 00000100:00100000:2.0:1787599240.331949:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599240.331970:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599240.331984:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543265280 00000100:00100000:2.0:1787599240.331987:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543265280 00000100:00100000:2.0:1787599240.332009:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599240.332015:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1874433543265280:12345-0@lo:700: 40000000:02000000:3.0:1787599240.398270:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787599240.404262:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1874433543265280:12345-0@lo:700: Request processed in 72236us (72302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599240.404296:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787599240.407807:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c76706a00 x1874433543265280/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787599256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599240.407891:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1874433543265280:0@lo:700: 40000000:02000000:2.0:1787599240.407907:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1787599240.470976:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787599240.470997:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787599240.471238:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8126:x1874433543265152:12345-0@lo:700: Request processed in 139343us (139611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599240.471251:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787599240.471368:0:8126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c70139f80 x1874433543265152/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787599256 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599240.471381:0:8126:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787599240.471402:0:8126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70139f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8126:1874433543265152:0@lo:700: 00000004:02000040:0.0:1787599240.495756:0:8126:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787599240.499761:0:8126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8126:1874433543265408:0@lo:5: 00000100:00100000:0.0:1787599240.499912:0:8126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599240.500067:0:8126:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4819dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599240.500149:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543265408 00000100:00100000:2.0:1787599240.502343:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543265408 00000100:00100000:2.0:1787599240.502411:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599240.502421:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8126:x1874433543265408:12345-0@lo:5: 00002000:00080000:2.0:1787599240.510869:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787599240.510892:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787599240.514510:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8126:x1874433543265408:12345-0@lo:5: Request processed in 12083us (14590us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787599240.514525:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787599240.514737:0:8126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466ed500 x1874433543265408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599256 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599240.514754:0:8126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8126:1874433543265408:0@lo:5: 00000004:00080000:2.0:1787599240.514770:0:8126:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787599241.189394:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787599241.358883:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1787599242.031226:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599242.031374:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522270336 00000100:00100000:0.0:1787599242.031391:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522270336 00000100:00100000:0.0:1787599242.031436:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 112 00000100:00100000:0.0:1787599242.031446:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1874433522270336:12345-192.168.204.30@tcp:250: 00010000:00080000:0.0:1787599242.031473:0:5826:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1ebe127c-c30c-4dc6-9c9b-887e7cd919f1@192.168.204.30@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1787599242.031505:0:5826:0:(genops.c:1385:class_connect()) connect: client 1ebe127c-c30c-4dc6-9c9b-887e7cd919f1, cookie 0xa46cbc6741182551 00000100:00080000:0.0:1787599242.031643:0:5826:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599242.031714:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+5:2355:x1874433522270336:12345-192.168.204.30@tcp:250: Request processed in 267us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599242.031722:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 112 00000100:00100000:3.0:1787599242.039838:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599242.039983:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522270464 00000100:00100000:0.0:1787599242.039993:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522270464 00000100:00100000:0.0:1787599242.040063:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 113 00000100:00100000:0.0:1787599242.040074:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+5:5584:x1874433522270464:12345-192.168.204.30@tcp:101: 00010000:00010000:0.0:1787599242.040093:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599242.040249:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40031600/0xa46cbc6741182558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07078 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599242.040368:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40031600/0xa46cbc6741182558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07078 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599242.040381:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40031600/0xa46cbc6741182558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07078 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599242.040463:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031600, rc 0) 00000100:00100000:0.0:1787599242.040570:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+6:5584:x1874433522270464:12345-192.168.204.30@tcp:101: Request processed in 498us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599242.040589:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 113 00000100:00100000:0.0:1787599242.047618:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599242.047724:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522270592 00000100:00100000:1.0:1787599242.047734:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522270592 00000100:00100000:1.0:1787599242.047788:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 114 00000100:00100000:1.0:1787599242.047807:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+6:5584:x1874433522270592:12345-192.168.204.30@tcp:501: 00000100:00100000:1.0:1787599242.048738:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+6:5584:x1874433522270592:12345-192.168.204.30@tcp:501: Request processed in 927us (1124us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599242.048749:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 114 00000100:00100000:3.0:1787599242.052808:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599242.052888:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522270720 00000100:00100000:0.0:1787599242.052898:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522270720 00000100:00100000:0.0:1787599242.052956:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:0.0:1787599242.052966:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+6:5584:x1874433522270720:12345-192.168.204.30@tcp:101: 00010000:00010000:0.0:1787599242.052982:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599242.053000:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40030e00/0xa46cbc674118255f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0707f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599242.053040:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40030e00/0xa46cbc674118255f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0707f expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599242.053052:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40030e00/0xa46cbc674118255f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0707f expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599242.053061:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030e00, rc 0) 00000100:00100000:0.0:1787599242.053134:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+7:5584:x1874433522270720:12345-192.168.204.30@tcp:101: Request processed in 168us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599242.053141:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:2.0:1787599242.057866:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599242.057980:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522270848 00000100:00100000:3.0:1787599242.057991:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522270848 00000100:00100000:3.0:1787599242.058060:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00100000:3.0:1787599242.058071:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+7:5584:x1874433522270848:12345-192.168.204.30@tcp:501: 00000100:00100000:3.0:1787599242.058551:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+8:5584:x1874433522270848:12345-192.168.204.30@tcp:501: Request processed in 480us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599242.058561:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00100000:3.0:1787599242.069732:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599242.069820:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522270976 00000100:00100000:1.0:1787599242.069829:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522270976 00000100:00100000:1.0:1787599242.069984:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:1.0:1787599242.069996:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+8:5584:x1874433522270976:12345-192.168.204.30@tcp:503: 00000100:00100000:1.0:1787599242.070683:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+8:5584:x1874433522270976:12345-192.168.204.30@tcp:503: Request processed in 686us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599242.070697:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:3.0:1787599242.073622:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599242.073693:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522271104 00000100:00100000:3.0:1787599242.073703:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522271104 00000100:00100000:3.0:1787599242.073749:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:3.0:1787599242.073759:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+8:5603:x1874433522271104:12345-192.168.204.30@tcp:502: 00000100:00100000:3.0:1787599242.074046:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+8:5603:x1874433522271104:12345-192.168.204.30@tcp:502: Request processed in 287us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599242.074054:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:3.0:1787599242.104780:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599242.104866:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522271232 00000100:00100000:1.0:1787599242.104875:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522271232 00000100:00100000:1.0:1787599242.104928:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:1.0:1787599242.104938:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+8:5603:x1874433522271232:12345-192.168.204.30@tcp:502: 00000100:00100000:1.0:1787599242.105531:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+8:5603:x1874433522271232:12345-192.168.204.30@tcp:502: Request processed in 592us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599242.105540:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:2.0:1787599242.122636:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599242.122721:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522271360 00000100:00100000:0.0:1787599242.122732:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522271360 00000100:00100000:0.0:1787599242.122790:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:0.0:1787599242.122800:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+8:5584:x1874433522271360:12345-192.168.204.30@tcp:101: 00010000:00010000:0.0:1787599242.122817:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599242.122853:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751ffc00/0xa46cbc6741182566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e070a9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599242.122891:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ffc00/0xa46cbc6741182566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070a9 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599242.122902:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751ffc00/0xa46cbc6741182566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070a9 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599242.122912:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ffc00, rc 0) 00000100:00100000:0.0:1787599242.122983:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5584:x1874433522271360:12345-192.168.204.30@tcp:101: Request processed in 183us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599242.122990:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:3.0:1787599242.135640:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599242.135739:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522271488 00000100:00100000:2.0:1787599242.135751:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522271488 00000100:00100000:2.0:1787599242.135814:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:2.0:1787599242.135825:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5584:x1874433522271488:12345-192.168.204.30@tcp:256: 20000000:01000000:2.0:1787599242.135850:0:5824:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787599242.135875:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787599242.135880:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787599242.135883:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787599242.135886:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787599242.138376:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5584:x1874433522271488:12345-192.168.204.30@tcp:256: Request processed in 2541us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599242.138398:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:2.0:1787599242.146317:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599242.146686:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522271616 00000100:00100000:3.0:1787599242.146696:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522271616 00000100:00100000:3.0:1787599242.146769:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:3.0:1787599242.146780:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5584:x1874433522271616:12345-192.168.204.30@tcp:101: 00010000:00010000:3.0:1787599242.146795:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599242.146811:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c5b24d800/0xa46cbc674118256d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e070b0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599242.146839:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c5b24d800/0xa46cbc674118256d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070b0 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599242.146851:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c5b24d800/0xa46cbc674118256d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070b0 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599242.146861:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d800, rc 0) 00000100:00100000:3.0:1787599242.146923:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5584:x1874433522271616:12345-192.168.204.30@tcp:101: Request processed in 145us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599242.146930:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:2.0:1787599242.162530:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599242.164605:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522271744 00000100:00100000:3.0:1787599242.164619:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522271744 00000100:00100000:3.0:1787599242.164681:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:3.0:1787599242.164692:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5584:x1874433522271744:12345-192.168.204.30@tcp:501: 00000100:00100000:3.0:1787599242.165111:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5584:x1874433522271744:12345-192.168.204.30@tcp:501: Request processed in 420us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599242.165120:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:2.0:1787599242.177990:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599242.179076:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522271872 00000100:00100000:3.0:1787599242.179088:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522271872 00000100:00100000:3.0:1787599242.179154:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:3.0:1787599242.179190:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5584:x1874433522271872:12345-192.168.204.30@tcp:503: 00000100:00100000:3.0:1787599242.179557:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5584:x1874433522271872:12345-192.168.204.30@tcp:503: Request processed in 367us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599242.179566:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:2.0:1787599242.183922:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599242.184002:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522272000 00000100:00100000:0.0:1787599242.184021:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522272000 00000100:00100000:0.0:1787599242.184074:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:0.0:1787599242.184084:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5608:x1874433522272000:12345-192.168.204.30@tcp:502: 00000100:00100000:0.0:1787599242.184349:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5608:x1874433522272000:12345-192.168.204.30@tcp:502: Request processed in 265us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599242.184357:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:1.0:1787599242.187203:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599242.187360:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522272128 00000100:00100000:3.0:1787599242.187370:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522272128 00000100:00100000:3.0:1787599242.187412:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:3.0:1787599242.187421:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5608:x1874433522272128:12345-192.168.204.30@tcp:502: 00000100:00100000:3.0:1787599242.187647:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5608:x1874433522272128:12345-192.168.204.30@tcp:502: Request processed in 226us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599242.187655:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:0.0:1787599242.195577:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599242.195701:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522272256 00000100:00100000:3.0:1787599242.195711:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522272256 00000100:00100000:3.0:1787599242.195802:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:3.0:1787599242.195811:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1874433522272256:12345-192.168.204.30@tcp:38: 00010000:00080000:3.0:1787599242.195839:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:3.0:1787599242.195883:0:5832:0:(genops.c:1385:class_connect()) connect: client 3d8318fd-1d0f-4438-bc2c-ebacb6a98551, cookie 0xa46cbc6741182574 00000004:00100000:3.0:1787599242.195911:0:5832:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787599242.195917:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1787599242.215264:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787599242.230098:0:5832:0:(import.c:65:import_set_state_nolock()) ffff9f6b44329800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599242.230545:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2355:x1874433522272256:12345-192.168.204.30@tcp:38: Request processed in 34731us (34973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599242.230557:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00010000:00010000:0.0:1787599243.233832:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599243.243225:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599243.243298:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522272384 00000100:00100000:3.0:1787599243.243311:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522272384 00000100:00100000:3.0:1787599243.243401:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00080000:0.0:1787599243.243442:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599243.243476:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:0:x1874433522272384:12345-192.168.204.30@tcp:41: 00000004:00000024:3.0:1787599243.243525:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787599243.243601:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:0:x1874433522272384:12345-192.168.204.30@tcp:41: Request processed in 189us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599243.248555:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599243.248660:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787599243.248672:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787599243.255755:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522272512 00000100:00100000:2.0:1787599243.255771:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522272512 00000100:00100000:3.0:1787599243.256415:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1787599243.256507:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:2.0:1787599243.256521:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:5584:x1874433522272512:12345-192.168.204.30@tcp:41: 00000004:00000024:2.0:1787599243.256578:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787599243.256661:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:5584:x1874433522272512:12345-192.168.204.30@tcp:41: Request processed in 143us (8116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599243.256668:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:0.0:1787599243.261842:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599243.262042:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522272640 00000100:00100000:1.0:1787599243.262052:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522272640 00000100:00100000:1.0:1787599243.262272:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1787599243.262285:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:5584:x1874433522272640:12345-192.168.204.30@tcp:40: 00000100:00100000:1.0:1787599243.262380:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:5584:x1874433522272640:12345-192.168.204.30@tcp:40: Request processed in 98us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599243.262387:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:0.0:1787599243.275082:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599243.275129:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599243.275256:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522272768 00000100:00100000:3.0:1787599243.275272:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522272768 00000100:00100000:3.0:1787599243.275321:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:3.0:1787599243.275330:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874433522272768:12345-192.168.204.30@tcp:8: 00010000:00080000:3.0:1787599243.275362:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1787599243.275394:0:6679:0:(genops.c:1385:class_connect()) connect: client 3d8318fd-1d0f-4438-bc2c-ebacb6a98551, cookie 0xa46cbc674118257b 00002000:00100000:3.0:1787599243.275405:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3d8318fd-1d0f-4438-bc2c-ebacb6a98551/ffff9f6b4432f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787599243.275431:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787599243.275799:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787599243.275831:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9f6c70856800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599243.275903:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2355:x1874433522272768:12345-192.168.204.30@tcp:8: Request processed in 572us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599243.275911:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:3.0:1787599243.279666:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599243.279713:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599243.279808:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522273152 00000100:00100000:0.0:1787599243.279831:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522273152 00000100:00100000:0.0:1787599243.279887:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:0.0:1787599243.279898:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c5843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2357:x1874433522273152:12345-192.168.204.30@tcp:400: 00000100:00100000:0.0:1787599243.279966:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c5843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2357:x1874433522273152:12345-192.168.204.30@tcp:400: Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599243.279974:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:1.0:1787599243.280809:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522272896 00000100:00100000:1.0:1787599243.280816:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522272896 00000100:00100000:1.0:1787599243.280856:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787599243.280863:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874433522272896:12345-192.168.204.30@tcp:8: 00010000:00080000:1.0:1787599243.280890:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:1.0:1787599243.280920:0:6677:0:(genops.c:1385:class_connect()) connect: client 3d8318fd-1d0f-4438-bc2c-ebacb6a98551, cookie 0xa46cbc6741182582 00002000:00100000:1.0:1787599243.280932:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3d8318fd-1d0f-4438-bc2c-ebacb6a98551/ffff9f6c81f35800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599243.280969:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599243.281372:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787599243.281403:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9f6c81f31800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599243.281453:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2355:x1874433522272896:12345-192.168.204.30@tcp:8: Request processed in 589us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599243.281459:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:2.0:1787599243.281874:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522273024 00000100:00100000:2.0:1787599243.281881:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522273024 00000100:00100000:2.0:1787599243.281914:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1787599243.281923:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:5584:x1874433522273024:12345-192.168.204.30@tcp:33: 00000100:00100000:0.0:1787599243.297490:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543265536:0@lo:13: 00000100:00100000:0.0:1787599243.297573:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599243.297758:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543265536 00000100:00100000:3.0:1787599243.297778:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543265536 00000100:00100000:3.0:1787599243.298841:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599243.298856:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543265536:12345-0@lo:13: 00002000:00000024:3.0:1787599243.298883:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599243.298954:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543265536:12345-0@lo:13: Request processed in 102us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599243.298961:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787599243.300581:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fa0f100 x1874433543265536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599243.300614:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543265536:0@lo:13: 00000100:00080000:0.0:1787599243.302359:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787599243.309886:0:5834:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27905us 00000004:00200000:3.0:1787599243.322968:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787599243.323178:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:5584:x1874433522273024:12345-192.168.204.30@tcp:33: Request processed in 41227us (48077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599243.323195:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:0.0:1787599243.557362:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599243.557730:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522273280 00000100:00100000:1.0:1787599243.557747:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522273280 00000100:00100000:1.0:1787599243.557832:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1787599243.557845:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:5625:x1874433522273280:12345-192.168.204.30@tcp:101: 00010000:00010000:1.0:1787599243.557881:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599243.557974:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9400/0xa46cbc6741182589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e070da expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599243.558570:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182590 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599243.558593:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599243.558613:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599243.558963:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787599243.558970:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599243.559395:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599243.559448:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9400/0xa46cbc6741182589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070da expref: 8 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599243.559473:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070da expref: 7 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599243.559484:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:1.0:1787599243.559487:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599243.559491:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8200, rc 0) 00000100:00100000:1.0:1787599243.559656:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:5625:x1874433522273280:12345-192.168.204.30@tcp:101: Request processed in 1812us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599243.559664:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00010000:00010000:0.0:1787599244.257680:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599245.281710:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599245.345764:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543266048:0@lo:400: 00000100:00100000:1.0:1787599245.345837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599245.345897:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787599245.345902:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543265664:0@lo:400: 00000100:00100000:1.0:1787599245.345928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599245.345961:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543266176:0@lo:400: 00000100:00100000:1.0:1787599245.345987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599245.346017:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543266048 00000100:00100000:1.0:1787599245.346024:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543266048 00000100:00100000:1.0:1787599245.346081:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599245.346092:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543266048:12345-0@lo:400: 00000100:00100000:1.0:1787599245.346147:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543266048:12345-0@lo:400: Request processed in 57us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599245.346189:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599245.346305:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543266176 00000100:00100000:2.0:1787599245.346310:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543266176 00000100:00100000:2.0:1787599245.346343:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787599245.346351:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543266176:12345-0@lo:400: 00000100:00100000:2.0:1787599245.346388:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543266176:12345-0@lo:400: Request processed in 39us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599245.346394:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787599245.346538:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543265664 00000100:00100000:0.0:1787599245.346543:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543265664 00000100:00100000:0.0:1787599245.346575:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787599245.346583:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543265664:12345-0@lo:400: 00000100:00100000:0.0:1787599245.346619:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543265664:12345-0@lo:400: Request processed in 37us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599245.346625:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787599245.346652:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599245.346657:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599245.346732:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543265792:0@lo:400: 00000100:00100000:3.0:1787599245.346765:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599245.346792:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543266304:0@lo:400: 00000100:00100000:3.0:1787599245.346813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599245.346830:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787599245.346836:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543265920:0@lo:400: 00000100:00100000:3.0:1787599245.346869:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599245.346889:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543266432:0@lo:13: 00000100:00100000:3.0:1787599245.346910:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599245.346937:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543266432 00000100:00100000:3.0:1787599245.346941:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543266432 00000100:00100000:3.0:1787599245.346990:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787599245.346997:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543266432:12345-0@lo:13: 00002000:00000024:3.0:1787599245.347027:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599245.347062:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543266432:12345-0@lo:13: Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599245.347068:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787599245.347104:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466ee300 x1874433543266432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599245.347114:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787599245.347133:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543266432:0@lo:13: 00000100:00080000:3.0:1787599245.347147:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599245.347187:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543265792 00000100:00100000:3.0:1787599245.347196:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543265792 00010000:00080000:1.0:1787599245.347321:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760ed500 x1874433543266048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599245.347332:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543266048:0@lo:400: 00000100:00100000:1.0:1787599245.347347:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543265664:0@lo:400: 00000100:00100000:1.0:1787599245.347358:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543266176:0@lo:400: 00000100:00100000:2.0:1787599245.347502:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543265920 00000100:00100000:2.0:1787599245.347506:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543265920 00000100:00100000:2.0:1787599245.347543:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599245.347549:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543265792:12345-0@lo:400: 00000100:00100000:2.0:1787599245.347591:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543265792:12345-0@lo:400: Request processed in 42us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599245.347597:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599245.347609:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599245.347616:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543265920:12345-0@lo:400: 00000100:00100000:2.0:1787599245.347643:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543265920:12345-0@lo:400: Request processed in 28us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599245.347656:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599245.347698:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543265920:0@lo:400: 00000100:00100000:2.0:1787599245.347708:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543265792:0@lo:400: 00000100:00080000:1.0:1787599245.347764:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599245.347815:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543266304 00000100:00100000:0.0:1787599245.347819:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543266304 00000100:00100000:0.0:1787599245.347849:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599245.347856:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543266304:12345-0@lo:400: 00000100:00100000:0.0:1787599245.347898:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543266304:12345-0@lo:400: Request processed in 43us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599245.347904:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787599245.347991:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760ef480 x1874433543266304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599245.348001:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543266304:0@lo:400: 00000001:00100000:2.0:1787599245.909636:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000100:00100000:2.0:1787599245.947542:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599245.947714:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522273408 00000100:00100000:0.0:1787599245.947726:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522273408 00000100:00100000:0.0:1787599245.947849:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:0.0:1787599245.947860:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:5677:x1874433522273408:12345-192.168.204.30@tcp:41: 00000004:00000024:0.0:1787599245.947903:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787599245.947988:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:5677:x1874433522273408:12345-192.168.204.30@tcp:41: Request processed in 129us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599245.947996:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00080000:1.0:1787599245.948371:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599245.951815:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599245.952005:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522273536 00000100:00100000:3.0:1787599245.952016:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522273536 00000100:00100000:3.0:1787599245.952096:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:3.0:1787599245.952116:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:5677:x1874433522273536:12345-192.168.204.30@tcp:13: 00002000:00000024:3.0:1787599245.952204:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599245.952265:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:5677:x1874433522273536:12345-192.168.204.30@tcp:13: Request processed in 160us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599245.952272:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00080000:1.0:1787599245.952552:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599245.954526:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599245.954623:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522273664 00000100:00100000:1.0:1787599245.954631:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522273664 00000100:00100000:1.0:1787599245.954687:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1787599245.954697:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:5677:x1874433522273664:12345-192.168.204.30@tcp:13: 00002000:00000024:1.0:1787599245.954721:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599245.954778:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:5677:x1874433522273664:12345-192.168.204.30@tcp:13: Request processed in 82us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599245.954794:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00080000:3.0:1787599245.957327:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787599246.306209:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599247.330664:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787599247.470727:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000001:00100000:0.0:1787599247.473898:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00010000:00010000:1.0:1787599248.360094:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599248.417538:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599248.417583:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543266560:0@lo:13: 00000100:00100000:0.0:1787599248.417703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599248.417866:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543266560 00000100:00100000:1.0:1787599248.417879:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543266560 00000100:00100000:1.0:1787599248.417978:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599248.417992:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543266560:12345-0@lo:13: 00002000:00000024:1.0:1787599248.418046:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599248.418123:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543266560:12345-0@lo:13: Request processed in 134us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599248.418144:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787599248.418229:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760ed500 x1874433543266560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599248.418254:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543266560:0@lo:13: 00000100:00080000:0.0:1787599248.418362:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599248.515070:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599248.515107:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599248.515128:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599248.515152:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599248.515212:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522273792 00000100:00100000:1.0:1787599248.515225:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522273792 00000100:00100000:1.0:1787599248.515294:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:1.0:1787599248.515307:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2357:x1874433522273792:12345-192.168.204.30@tcp:400: 00000100:00100000:1.0:1787599248.515393:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2357:x1874433522273792:12345-192.168.204.30@tcp:400: Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599248.515400:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:1.0:1787599248.515438:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522274048 00000100:00100000:1.0:1787599248.515442:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522274048 00000100:00100000:1.0:1787599248.515480:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522274176 00000100:00100000:1.0:1787599248.515483:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522274176 00000100:00100000:1.0:1787599248.515502:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1787599248.515510:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522274048:12345-192.168.204.30@tcp:400: 00000100:00100000:1.0:1787599248.515558:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522274048:12345-192.168.204.30@tcp:400: Request processed in 49us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599248.515568:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1787599248.515580:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787599248.515585:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522274176:12345-192.168.204.30@tcp:400: 00000100:00100000:1.0:1787599248.515620:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522274176:12345-192.168.204.30@tcp:400: Request processed in 35us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599248.515626:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787599248.515643:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522273920 00000100:00100000:1.0:1787599248.515646:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522273920 00000100:00100000:1.0:1787599248.515689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:1.0:1787599248.515699:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522273920:12345-192.168.204.30@tcp:400: 00000100:00100000:1.0:1787599248.515727:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522273920:12345-192.168.204.30@tcp:400: Request processed in 33us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599248.515734:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00080000:1.0:1787599248.515875:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599248.515880:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599248.515882:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787599248.831365:0:8278:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787599249.377604:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599250.402641:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599250.465727:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543266816:0@lo:400: 00000100:00100000:0.0:1787599250.465808:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599250.465913:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543267072:0@lo:400: 00000100:00100000:1.0:1787599250.466080:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543266688:0@lo:400: 00000100:00100000:2.0:1787599250.470001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599250.470252:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543266816 00000100:00100000:2.0:1787599250.470263:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543266816 00000100:00100000:2.0:1787599250.470523:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787599250.470534:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543266816:12345-0@lo:400: 00000100:00100000:2.0:1787599250.470595:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543266816:12345-0@lo:400: Request processed in 63us (4786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599250.470602:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787599250.470631:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543266944:0@lo:400: 00000100:00100000:2.0:1787599250.470666:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599250.470751:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543267072 00000100:00100000:1.0:1787599250.470757:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543267072 00000100:00100000:1.0:1787599250.470806:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599250.470815:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543267072:12345-0@lo:400: 00000100:00100000:1.0:1787599250.470936:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543267072:12345-0@lo:400: Request processed in 122us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599250.470943:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599250.470961:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543266944 00000100:00100000:1.0:1787599250.470965:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543266944 00000100:00100000:1.0:1787599250.470990:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599250.470996:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543266944:12345-0@lo:400: 00000100:00100000:1.0:1787599250.471032:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543266944:12345-0@lo:400: Request processed in 36us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599250.471051:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599250.471097:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543266944:0@lo:400: 00010000:00080000:1.0:1787599250.471216:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fe21c00 x1874433543267072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599250.471402:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543267072:0@lo:400: 00000100:00100000:1.0:1787599250.471500:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599250.471530:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543266688 00000100:00100000:1.0:1787599250.471534:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543266688 00000100:00100000:1.0:1787599250.471562:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787599250.471568:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543266688:12345-0@lo:400: 00000100:00100000:1.0:1787599250.471602:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543266688:12345-0@lo:400: Request processed in 34us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599250.471608:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787599250.471650:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543266688:0@lo:400: 00000100:00100000:1.0:1787599250.471658:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543267200:0@lo:400: 00000100:00100000:1.0:1787599250.471683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599250.471704:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543267200 00000100:00100000:1.0:1787599250.471707:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543267200 00000100:00100000:1.0:1787599250.471732:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599250.471739:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543267200:12345-0@lo:400: 00000100:00100000:1.0:1787599250.471769:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543267200:12345-0@lo:400: Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599250.471774:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599250.471799:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543267200:0@lo:400: 00000100:00100000:0.0:1787599250.472009:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543266816:0@lo:400: 00000100:00100000:0.0:1787599250.472018:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543267328:0@lo:400: 00000100:00100000:0.0:1787599250.472042:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599250.472065:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543267328 00000100:00100000:0.0:1787599250.472069:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543267328 00000100:00100000:0.0:1787599250.472098:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599250.472104:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543267328:12345-0@lo:400: 00000100:00100000:0.0:1787599250.472147:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543267328:12345-0@lo:400: Request processed in 43us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599250.472153:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787599250.472204:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fe22300 x1874433543267328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599250.472214:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543267328:0@lo:400: 00000100:00100000:0.0:1787599250.472509:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599250.472517:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543267456:0@lo:13: 00000100:00100000:0.0:1787599250.472544:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599250.472574:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543267456 00000100:00100000:0.0:1787599250.472578:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543267456 00000100:00100000:0.0:1787599250.472606:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599250.472612:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543267456:12345-0@lo:13: 00002000:00000024:0.0:1787599250.472639:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599250.472672:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543267456:12345-0@lo:13: Request processed in 60us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599250.472679:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787599250.472704:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fe20700 x1874433543267456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599250.472719:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543267456:0@lo:13: 00000100:00080000:2.0:1787599250.472888:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599250.472893:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599250.472895:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787599251.432222:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599252.452074:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599253.475000:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599253.545720:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599253.545755:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543267584:0@lo:13: 00000100:00100000:1.0:1787599253.545863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599253.545976:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543267584 00000100:00100000:0.0:1787599253.545987:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543267584 00000100:00100000:0.0:1787599253.546070:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599253.546081:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543267584:12345-0@lo:13: 00002000:00000024:0.0:1787599253.546129:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599253.546216:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543267584:12345-0@lo:13: Request processed in 137us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599253.546224:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787599253.546282:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760efb80 x1874433543267584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599253.546321:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543267584:0@lo:13: 00000100:00080000:1.0:1787599253.546392:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599253.635807:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599253.635873:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599253.635895:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522274304 00000100:00100000:1.0:1787599253.635913:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522274304 00000100:00100000:2.0:1787599253.635945:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599253.636000:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:2.0:1787599253.636006:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599253.636021:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2359:x1874433522274304:12345-192.168.204.30@tcp:400: 00000100:00100000:2.0:1787599253.636050:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522274560 00000100:00100000:2.0:1787599253.636061:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522274560 00000100:00100000:2.0:1787599253.636138:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522274688 00000100:00100000:1.0:1787599253.636141:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2359:x1874433522274304:12345-192.168.204.30@tcp:400: Request processed in 124us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.636144:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522274688 00000100:00100000:2.0:1787599253.636214:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1787599253.636223:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:2.0:1787599253.636233:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522274560:12345-192.168.204.30@tcp:400: 00000100:00100000:1.0:1787599253.636281:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522274432 00000100:00100000:1.0:1787599253.636288:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522274432 00000100:00100000:2.0:1787599253.636305:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522274560:12345-192.168.204.30@tcp:400: Request processed in 76us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.636316:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1787599253.636340:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:2.0:1787599253.636346:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:2.0:1787599253.636357:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522274688:12345-192.168.204.30@tcp:400: 00000100:00100000:1.0:1787599253.636369:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522274432:12345-192.168.204.30@tcp:400: 00000100:00100000:2.0:1787599253.636392:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522274688:12345-192.168.204.30@tcp:400: Request processed in 35us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.636400:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1787599253.636421:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522274432:12345-192.168.204.30@tcp:400: Request processed in 56us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599253.636430:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00080000:1.0:1787599253.636458:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599253.636462:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599253.636465:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1787599253.738943:0:8426:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffca8455e0 20000000:00000080:1.0:1787599253.738960:0:8426:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f6c75f17c00 uarg=0000000000000000 20000000:01000000:1.0:1787599253.738994:0:8426:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787599253.738997:0:8426:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787599253.739000:0:8426:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787599253.739004:0:8426:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787599253.739015:0:8426:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787599253.739029:0:8426:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787599253.739031:0:8426:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787599253.739491:0:8426:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787599253.739494:0:8426:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787599253.740589:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787599253.741139:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787599253.741592:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787599253.741623:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787599253.741634:0:8426:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787599253.741636:0:8426:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787599253.742824:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787599253.743474:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787599253.743524:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787599253.743579:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787599253.743592:0:8426:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787599253.743595:0:8426:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787599253.744626:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787599253.745003:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787599253.745134:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787599253.745561:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787599253.745577:0:8426:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787599253.745579:0:8426:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787599253.746447:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787599253.746956:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787599253.747004:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787599253.747035:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1787599253.747048:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787599253.747140:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.747308:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c582d8800/0xa46cbc6741182494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118248d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.747329:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c40031800/0xa46cbc67411824be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411824b7 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.747336:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c582d9000/0xa46cbc67411824e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411824e1 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.747408:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411824f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411824ef expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.747415:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c40030200/0xa46cbc6741182504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411824fd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.747422:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182519 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.747429:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c582d9200/0xa46cbc674118254a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182543 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.747439:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c40031600/0xa46cbc6741182558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07078 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.747446:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c40030e00/0xa46cbc674118255f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0707f expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.747453:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.747578:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c40030e00/0xa46cbc674118255f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0707f expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.747597:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c40030e00/0xa46cbc674118255f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0707f expref: 9 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.747613:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543267712:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599253.747758:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c40031600/0xa46cbc6741182558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07078 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.747767:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c40031600/0xa46cbc6741182558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07078 expref: 9 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.747792:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543267840:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599253.747826:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c582d9200/0xa46cbc674118254a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741182543 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.747833:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c582d9200/0xa46cbc674118254a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741182543 expref: 18 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.747841:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543267968:0@lo:104: 00000100:00100000:3.0:1787599253.747878:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599253.747922:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741182519 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.747930:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741182519 expref: 18 pid: 5826 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.747936:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543268096:0@lo:104: 00000100:00100000:3.0:1787599253.747956:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599253.747987:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c40030200/0xa46cbc6741182504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411824fd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.747994:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c40030200/0xa46cbc6741182504 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411824fd expref: 18 pid: 5824 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.748001:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543268224:0@lo:104: 00010000:00010000:3.0:1787599253.748020:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411824f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411824ef expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.748027:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411824f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411824ef expref: 18 pid: 5826 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.748039:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543268352:0@lo:104: 00000100:00100000:2.0:1787599253.748213:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787599253.748231:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599253.748251:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599253.748260:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543267968 00000100:00100000:2.0:1787599253.748266:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543267968 00000100:00100000:2.0:1787599253.748301:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543268096 00000100:00100000:2.0:1787599253.748304:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543268096 00000100:00100000:2.0:1787599253.748313:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543268224 00000100:00100000:2.0:1787599253.748315:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543268224 00000100:00100000:2.0:1787599253.748325:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543268352 00000100:00100000:2.0:1787599253.748327:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543268352 00000100:00100000:2.0:1787599253.748338:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599253.748359:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+6:8426:x1874433543267968:12345-0@lo:104: 00010000:00010000:2.0:1787599253.748373:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748423:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599253.748428:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+6:8426:x1874433543267968:12345-0@lo:104: Request processed in 72us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.748435:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599253.748451:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599253.748457:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:8426:x1874433543268096:12345-0@lo:104: 00010000:00010000:2.0:1787599253.748465:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748503:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787599253.748508:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:8426:x1874433543268096:12345-0@lo:104: Request processed in 52us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.748513:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599253.748543:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599253.748549:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:8426:x1874433543268224:12345-0@lo:104: 00010000:00010000:2.0:1787599253.748564:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748590:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787599253.748595:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:8426:x1874433543268224:12345-0@lo:104: Request processed in 46us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.748600:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599253.748615:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599253.748621:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:8426:x1874433543268352:12345-0@lo:104: 00010000:00010000:2.0:1787599253.748628:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748652:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787599253.748657:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:8426:x1874433543268352:12345-0@lo:104: Request processed in 37us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.748662:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787599253.748679:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787599253.748684:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748691:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031e00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:2.0:1787599253.748694:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748702:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599253.748709:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599253.748721:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599253.748751:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748757:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599253.748775:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748793:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c40031e00/0xa46cbc6741182543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118254a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748806:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787599253.748809:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748815:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031c00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:2.0:1787599253.748818:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748824:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599253.748830:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599253.748834:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599253.748847:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748852:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599253.748872:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748879:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc6741182519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182520 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748887:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599253.748890:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748895:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8e00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:2.0:1787599253.748897:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748903:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599253.748909:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599253.748914:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599253.748927:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748931:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599253.748936:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748941:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8e00/0xa46cbc67411824fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748949:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599253.748958:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748963:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030a00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:2.0:1787599253.748965:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748972:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599253.748977:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599253.748981:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599253.748994:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.748999:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599253.749004:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.749009:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c40030a00/0xa46cbc67411824ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.749019:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599253.749021:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599253.749022:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599253.749036:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543268864:0@lo:103: 00000100:00100000:2.0:1787599253.749230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599253.749259:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599253.749264:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543268480:0@lo:103: 00000100:00100000:2.0:1787599253.749295:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599253.749321:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543268864 00000100:00100000:2.0:1787599253.749326:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543268864 00010000:00010000:2.0:1787599253.749405:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411824f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411824ef expref: 19 pid: 5826 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599253.749427:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543268480 00000100:00100000:2.0:1787599253.749430:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543268480 00010000:00010000:2.0:1787599253.749442:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c582d9200/0xa46cbc674118254a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182543 expref: 20 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599253.749455:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599253.749461:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+20:3299:x1874433543268864:12345-0@lo:103: 00010000:00010000:2.0:1787599253.749470:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599253.749475:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411824f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411824ef expref: 20 pid: 5826 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.749531:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599253.749542:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787599253.749549:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787599253.749777:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543268608:0@lo:103: 00000100:00100000:0.0:1787599253.749817:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599253.749841:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599253.749847:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543268736:0@lo:103: 00000100:00100000:0.0:1787599253.749865:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599253.749933:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411824f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411824ef expref: 20 pid: 5826 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.749953:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599253.749991:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+20:3299:x1874433543268864:12345-0@lo:103: Request processed in 531us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.749998:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599253.750012:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543268608 00000100:00100000:2.0:1787599253.750015:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543268608 00010000:00010000:2.0:1787599253.750027:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182520 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182519 expref: 20 pid: 5826 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599253.750037:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543268736 00000100:00100000:2.0:1787599253.750046:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543268736 00010000:00010000:2.0:1787599253.750068:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c40030200/0xa46cbc6741182504 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411824fd expref: 21 pid: 5824 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599253.750082:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599253.750089:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+21:3299:x1874433543268480:12345-0@lo:103: 00010000:00010000:2.0:1787599253.750096:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599253.750099:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c582d9200/0xa46cbc674118254a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182543 expref: 21 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.750108:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c582d9200/0xa46cbc674118254a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741182543 expref: 21 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.750118:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599253.750139:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+21:3299:x1874433543268480:12345-0@lo:103: Request processed in 51us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.750145:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599253.750205:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599253.750211:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+20:3301:x1874433543268608:12345-0@lo:103: 00010000:00010000:2.0:1787599253.750219:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599253.750223:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182520 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182519 expref: 20 pid: 5826 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.750231:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741182519 expref: 20 pid: 5826 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.750241:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599253.750265:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+20:3301:x1874433543268608:12345-0@lo:103: Request processed in 55us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.750271:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599253.750292:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599253.750298:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543268736:12345-0@lo:103: 00010000:00010000:2.0:1787599253.750305:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599253.750309:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c40030200/0xa46cbc6741182504 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411824fd expref: 19 pid: 5824 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.750316:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c40030200/0xa46cbc6741182504 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411824fd expref: 19 pid: 5824 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599253.750324:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599253.750461:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543268736:12345-0@lo:103: Request processed in 162us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599253.750466:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787599253.750602:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543268736:0@lo:103: 00000100:00100000:0.0:1787599253.750609:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543268608:0@lo:103: 00000100:00100000:0.0:1787599253.750633:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543268480:0@lo:103: 00000100:00100000:0.0:1787599253.750639:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543268864:0@lo:103: 00010000:00010000:3.0:1787599253.751135:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c582d9000/0xa46cbc67411824e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411824e1 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.751146:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c582d9000/0xa46cbc67411824e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411824e1 expref: 18 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.751318:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543268992:0@lo:104: 00000100:00100000:3.0:1787599253.751363:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599253.751406:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c40031800/0xa46cbc67411824be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411824b7 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.751416:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c40031800/0xa46cbc67411824be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411824b7 expref: 18 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.751425:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543269120:0@lo:104: 00000100:00100000:3.0:1787599253.751444:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599253.751474:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c582d8800/0xa46cbc6741182494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc674118248d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.751483:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c582d8800/0xa46cbc6741182494 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc674118248d expref: 18 pid: 5824 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.751491:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543269248:0@lo:104: 00000100:00100000:3.0:1787599253.751509:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599253.751527:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086fc00 going to sleep for 11 seconds 00010000:00010000:3.0:1787599253.751542:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d9200/0xa46cbc674118254a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741182543 expref: 18 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.751553:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543267968:0@lo:104: 00010000:00010000:3.0:1787599253.751563:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc6741182520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741182519 expref: 17 pid: 5826 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.751572:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543268096:0@lo:104: 00010000:00010000:3.0:1787599253.751582:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c40030200/0xa46cbc6741182504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411824fd expref: 16 pid: 5824 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.751591:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543268224:0@lo:104: 00010000:00010000:3.0:1787599253.751599:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411824f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411824ef expref: 15 pid: 5826 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.751607:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543268352:0@lo:104: 00000100:00100000:1.0:1787599253.751715:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543268992 00000100:00100000:1.0:1787599253.751722:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543268992 00000100:00100000:1.0:1787599253.751751:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543269120 00000100:00100000:1.0:1787599253.751754:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543269120 00000100:00100000:1.0:1787599253.751763:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543269248 00000100:00100000:1.0:1787599253.751766:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543269248 00000100:00100000:1.0:1787599253.751777:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599253.751796:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:8426:x1874433543268992:12345-0@lo:104: 00010000:00010000:1.0:1787599253.751808:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.751862:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599253.751874:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:8426:x1874433543268992:12345-0@lo:104: Request processed in 90us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599253.751881:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599253.751897:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599253.751903:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:8426:x1874433543269120:12345-0@lo:104: 00010000:00010000:1.0:1787599253.751911:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.751944:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787599253.751949:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:8426:x1874433543269120:12345-0@lo:104: Request processed in 47us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599253.751956:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599253.751967:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599253.751972:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:8426:x1874433543269248:12345-0@lo:104: 00010000:00010000:1.0:1787599253.751979:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752003:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787599253.752007:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:8426:x1874433543269248:12345-0@lo:104: Request processed in 36us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599253.752014:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787599253.752027:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787599253.752033:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752041:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599253.752045:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752076:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599253.752084:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599253.752091:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599253.752116:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752123:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599253.752138:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752146:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411824e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752182:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599253.752186:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752192:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599253.752195:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752203:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599253.752210:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599253.752220:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599253.752233:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752240:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599253.752251:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752258:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75619200/0xa46cbc67411824b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824be expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752268:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599253.752271:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752277:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618800 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599253.752281:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752288:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599253.752295:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599253.752300:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599253.752310:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752315:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599253.752326:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752333:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75618800/0xa46cbc674118248d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182494 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752452:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599253.752454:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599253.752456:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599253.752463:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599253.752473:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543269632:0@lo:103: 00000100:00100000:1.0:1787599253.752501:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599253.752531:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599253.752536:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543269504:0@lo:103: 00000100:00100000:1.0:1787599253.752555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599253.752577:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543269632 00000100:00100000:1.0:1787599253.752581:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543269632 00010000:00010000:1.0:1787599253.752597:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c582d8800/0xa46cbc6741182494 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118248d expref: 15 pid: 5824 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599253.752611:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543269504 00000100:00100000:1.0:1787599253.752614:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543269504 00010000:00010000:1.0:1787599253.752624:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c40031800/0xa46cbc67411824be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411824b7 expref: 16 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599253.752635:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599253.752642:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3302:x1874433543269632:12345-0@lo:103: 00010000:00010000:1.0:1787599253.752650:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599253.752654:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c582d8800/0xa46cbc6741182494 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118248d expref: 16 pid: 5824 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752675:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c582d8800/0xa46cbc6741182494 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc674118248d expref: 16 pid: 5824 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752691:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599253.752720:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3302:x1874433543269632:12345-0@lo:103: Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599253.752725:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599253.752738:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599253.752744:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:3302:x1874433543269504:12345-0@lo:103: 00010000:00010000:1.0:1787599253.752751:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599253.752756:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c40031800/0xa46cbc67411824be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411824b7 expref: 15 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752763:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c40031800/0xa46cbc67411824be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411824b7 expref: 15 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752772:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599253.752803:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:3302:x1874433543269504:12345-0@lo:103: Request processed in 60us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599253.752808:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599253.752830:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543269376:0@lo:103: 00000100:00100000:1.0:1787599253.752856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599253.752896:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543269504:0@lo:103: 00000100:00100000:1.0:1787599253.752905:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543269632:0@lo:103: 00000100:00100000:1.0:1787599253.752928:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543269376 00000100:00100000:1.0:1787599253.752932:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543269376 00010000:00010000:1.0:1787599253.752952:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c582d9000/0xa46cbc67411824e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411824e1 expref: 15 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599253.752968:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599253.752974:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58443050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:3300:x1874433543269376:12345-0@lo:103: 00010000:00010000:1.0:1787599253.752981:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599253.752985:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c582d9000/0xa46cbc67411824e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411824e1 expref: 15 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.752993:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c582d9000/0xa46cbc67411824e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411824e1 expref: 15 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.753001:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599253.753029:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58443050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:3300:x1874433543269376:12345-0@lo:103: Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599253.753034:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599253.753147:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543269376:0@lo:103: 00010000:00010000:3.0:1787599253.753312:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d9000/0xa46cbc67411824e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411824e1 expref: 14 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.753323:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543268992:0@lo:104: 00010000:00010000:3.0:1787599253.753331:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c40031800/0xa46cbc67411824be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411824b7 expref: 13 pid: 5825 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.753338:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543269120:0@lo:104: 00010000:00010000:3.0:1787599253.753362:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d8800/0xa46cbc6741182494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc674118248d expref: 12 pid: 5824 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.753370:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543269248:0@lo:104: 00000100:00100000:1.0:1787599253.755797:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599253.755826:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599253.755854:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522274944 00000100:00100000:1.0:1787599253.755864:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522274944 00010000:00010000:1.0:1787599253.755901:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c40031600/0xa46cbc6741182558 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07078 expref: 10 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599253.755923:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522274816 00000100:00100000:1.0:1787599253.755926:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522274816 00010000:00010000:1.0:1787599253.755936:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c40030e00/0xa46cbc674118255f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0707f expref: 11 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599253.755948:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:1.0:1787599253.755969:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:2358:x1874433522274944:12345-192.168.204.30@tcp:103: 00010000:00010000:1.0:1787599253.755983:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599253.755988:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c40031600/0xa46cbc6741182558 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07078 expref: 11 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.755998:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c40031600/0xa46cbc6741182558 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07078 expref: 11 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756016:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599253.756065:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:2358:x1874433522274944:12345-192.168.204.30@tcp:103: Request processed in 97us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599253.756072:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:1.0:1787599253.756090:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:1.0:1787599253.756095:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522274816:12345-192.168.204.30@tcp:103: 00010000:00010000:1.0:1787599253.756102:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599253.756106:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c40030e00/0xa46cbc674118255f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0707f expref: 10 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756116:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c40030e00/0xa46cbc674118255f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0707f expref: 10 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756127:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756136:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756150:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756190:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756197:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756203:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756209:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599253.756213:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756220:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756227:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599253.756237:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599253.756254:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522274816:12345-192.168.204.30@tcp:103: Request processed in 159us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599253.756259:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00010000:00010000:3.0:1787599253.756470:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c40030e00/0xa46cbc674118255f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0707f expref: 9 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.756487:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543267712:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599253.756499:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c40031600/0xa46cbc6741182558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07078 expref: 8 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599253.756508:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8426:1874433543267840:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599253.756549:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.756558:0:8426:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.756565:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599253.756572:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75619000/0xa46cbc6741182597 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599254.498120:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599255.425027:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599255.425207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522275072 00000100:00100000:2.0:1787599255.425217:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522275072 00000100:00100000:2.0:1787599255.425278:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:2.0:1787599255.425289:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+8:5598:x1874433522275072:12345-192.168.204.30@tcp:101: 00010000:00010000:2.0:1787599255.425307:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599255.425327:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75619a00/0xa46cbc674118259e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e070e1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.425355:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75619a00/0xa46cbc674118259e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070e1 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.425377:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75619a00/0xa46cbc674118259e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070e1 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.425385:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619a00, rc 0) 00000100:00100000:2.0:1787599255.425448:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5598:x1874433522275072:12345-192.168.204.30@tcp:101: Request processed in 161us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.425468:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:1.0:1787599255.429916:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599255.430627:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522275200 00000100:00100000:2.0:1787599255.430639:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522275200 00000100:00100000:2.0:1787599255.430710:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:2.0:1787599255.430723:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5598:x1874433522275200:12345-192.168.204.30@tcp:501: 00000100:00100000:2.0:1787599255.431066:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5598:x1874433522275200:12345-192.168.204.30@tcp:501: Request processed in 345us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.432472:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:3.0:1787599255.434608:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599255.434724:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522275328 00000100:00100000:1.0:1787599255.434736:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522275328 00000100:00100000:1.0:1787599255.434824:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:1.0:1787599255.434844:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5598:x1874433522275328:12345-192.168.204.30@tcp:503: 00000100:00100000:1.0:1787599255.435071:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5598:x1874433522275328:12345-192.168.204.30@tcp:503: Request processed in 236us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.435078:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:3.0:1787599255.441133:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599255.441407:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522275456 00000100:00100000:2.0:1787599255.441418:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522275456 00000100:00100000:2.0:1787599255.441474:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:2.0:1787599255.441484:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:6072:x1874433522275456:12345-192.168.204.30@tcp:502: 00000100:00100000:2.0:1787599255.442179:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:6072:x1874433522275456:12345-192.168.204.30@tcp:502: Request processed in 670us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.442189:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:3.0:1787599255.448520:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599255.448892:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522275584 00000100:00100000:2.0:1787599255.448903:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522275584 00000100:00100000:2.0:1787599255.448968:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 136 00000100:00100000:2.0:1787599255.448979:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:6072:x1874433522275584:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599255.449496:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:6072:x1874433522275584:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 517us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.449506:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 136 00000100:00100000:3.0:1787599255.452693:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599255.453112:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522275712 00000100:00100000:2.0:1787599255.453123:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522275712 00000100:00100000:2.0:1787599255.453210:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:2.0:1787599255.454390:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5598:x1874433522275712:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599255.454411:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599255.454432:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75618400/0xa46cbc67411825a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e070e8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.454460:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75618400/0xa46cbc67411825a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070e8 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.454471:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75618400/0xa46cbc67411825a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070e8 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.454479:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618400, rc 0) 00000100:00100000:2.0:1787599255.454547:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5598:x1874433522275712:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 1317us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.454554:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:3.0:1787599255.463252:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599255.463437:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522275840 00000100:00100000:0.0:1787599255.463448:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522275840 00000100:00100000:0.0:1787599255.463506:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:0.0:1787599255.463517:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5598:x1874433522275840:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599255.473039:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5598:x1874433522275840:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 9497us (9790us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599255.473055:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 138 00010000:00010000:1.0:1787599255.527542:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599255.586187:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599255.586213:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543269760:0@lo:13: 00000100:00100000:3.0:1787599255.586303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.586849:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543269760 00000100:00100000:0.0:1787599255.586859:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543269760 00000100:00100000:0.0:1787599255.586928:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787599255.586937:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543269760:12345-0@lo:13: 00002000:00000024:0.0:1787599255.586976:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599255.587048:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543269760:12345-0@lo:13: Request processed in 112us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599255.587069:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787599255.587186:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599255.587240:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543269888:0@lo:400: 00000100:00100000:3.0:1787599255.587290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.587495:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543269888 00000100:00100000:2.0:1787599255.587499:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543269888 00000100:00100000:2.0:1787599255.587538:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787599255.587545:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3300:x1874433543269888:12345-0@lo:400: 00000100:00100000:2.0:1787599255.587582:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:3300:x1874433543269888:12345-0@lo:400: Request processed in 38us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.587587:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787599255.587800:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543270400:0@lo:400: 00000100:00100000:3.0:1787599255.587834:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787599255.587876:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fe21180 x1874433543269760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599255.587895:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543269760:0@lo:13: 00000100:00100000:3.0:1787599255.587916:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543269888:0@lo:400: 00000100:00100000:3.0:1787599255.587924:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599255.587930:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543270272:0@lo:400: 00000100:00100000:3.0:1787599255.587953:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.588046:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543270272 00000100:00100000:2.0:1787599255.588051:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543270272 00000100:00100000:2.0:1787599255.588094:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599255.588101:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543270272:12345-0@lo:400: 00000100:00100000:2.0:1787599255.588139:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543270272:12345-0@lo:400: Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.588183:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787599255.588562:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543270400 00000100:00100000:0.0:1787599255.588569:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543270400 00000100:00100000:0.0:1787599255.588605:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787599255.588612:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543270400:12345-0@lo:400: 00000100:00100000:0.0:1787599255.588657:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543270400:12345-0@lo:400: Request processed in 45us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599255.588663:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787599255.588783:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543270016:0@lo:400: 00000100:00100000:1.0:1787599255.588818:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599255.588845:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599255.588851:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543270144:0@lo:400: 00000100:00100000:1.0:1787599255.588873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599255.588901:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543270016 00000100:00100000:1.0:1787599255.588905:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543270016 00000100:00100000:1.0:1787599255.588927:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543270144 00000100:00100000:1.0:1787599255.588929:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543270144 00000100:00100000:1.0:1787599255.588946:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599255.588951:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543270016:12345-0@lo:400: 00000100:00100000:1.0:1787599255.588986:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543270016:12345-0@lo:400: Request processed in 34us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.588992:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599255.589004:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599255.589011:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543270144:12345-0@lo:400: 00000100:00100000:1.0:1787599255.589056:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543270144:12345-0@lo:400: Request processed in 46us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.589063:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599255.589094:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543270144:0@lo:400: 00000100:00100000:1.0:1787599255.589105:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543270016:0@lo:400: 10000000:01000000:0.0:1787599255.589232:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787599255.589238:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6b4432d000 from 39 10000000:01000000:0.0:1787599255.589242:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787599255.589278:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599255.589288:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599255.589316:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599255.589332:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543270528:0@lo:101: 00000100:00100000:0.0:1787599255.589369:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.589636:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855b40 going to sleep for 11 seconds 00000100:00080000:3.0:1787599255.590122:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599255.590128:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787599255.590181:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c6f27f100 x1874433543270272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599255.590194:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543270272:0@lo:400: 00000100:00100000:3.0:1787599255.590207:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543270400:0@lo:400: 00000100:00100000:1.0:1787599255.590347:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543270528 00000100:00100000:1.0:1787599255.590371:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543270528 00000100:00100000:1.0:1787599255.590735:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787599255.590746:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+12:5828:x1874433543270528:12345-0@lo:101: 00010000:00010000:1.0:1787599255.590771:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599255.590790:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d9400/0xa46cbc67411825b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411825ac expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.590818:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d9400/0xa46cbc67411825b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411825ac expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.590829:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d9400/0xa46cbc67411825b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411825ac expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.590840:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9400, rc 0) 00000100:00100000:1.0:1787599255.590904:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543270528:12345-0@lo:101: Request processed in 160us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.590911:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787599255.591066:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543270528:0@lo:101: 00010000:00010000:0.0:1787599255.591085:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599255.591095:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599255.591202:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543270656:0@lo:501: 00000100:00100000:0.0:1787599255.591235:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.591273:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.591646:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543270656 00000100:00100000:2.0:1787599255.591654:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543270656 00000100:00100000:2.0:1787599255.591700:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787599255.591709:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543270656:12345-0@lo:501: 00000100:00100000:2.0:1787599255.592036:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543270656:12345-0@lo:501: Request processed in 318us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.592044:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787599255.593138:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543270656:0@lo:501: 00000100:00100000:0.0:1787599255.593224:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543270784:0@lo:503: 00000100:00100000:0.0:1787599255.593284:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.593346:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.594137:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543270784 00000100:00100000:2.0:1787599255.594146:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543270784 00000100:00100000:2.0:1787599255.594228:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787599255.594238:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543270784:12345-0@lo:503: 00000100:00100000:2.0:1787599255.594651:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543270784:12345-0@lo:503: Request processed in 413us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.594658:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787599255.595196:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543270784:0@lo:503: 00000100:00100000:2.0:1787599255.596925:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8444:1874433543270912:0@lo:502: 00000100:00100000:2.0:1787599255.597015:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.597558:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.601626:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543270912 00000100:00100000:1.0:1787599255.601641:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543270912 00000100:00100000:1.0:1787599255.601765:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787599255.601776:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:8444:x1874433543270912:12345-0@lo:502: 00000100:00100000:1.0:1787599255.602118:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:8444:x1874433543270912:12345-0@lo:502: Request processed in 342us (5101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.602126:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787599255.602248:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8444:1874433543270912:0@lo:502: 00000100:00100000:3.0:1787599255.602347:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8444:1874433543271040:0@lo:502: 00000100:00100000:3.0:1787599255.602399:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599255.605255:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.605591:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543271040 00000100:00100000:2.0:1787599255.605601:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543271040 00000100:00100000:2.0:1787599255.605653:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787599255.605664:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:8444:x1874433543271040:12345-0@lo:502: 00000100:00100000:2.0:1787599255.605984:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:8444:x1874433543271040:12345-0@lo:502: Request processed in 320us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.605993:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787599255.606235:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8444:1874433543271040:0@lo:502: 00000040:00080000:3.0:1787599255.606270:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787599255.606827:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787599255.606857:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599255.606867:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.606878:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599255.606887:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787599255.606890:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787599255.606892:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787599255.606922:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.606930:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.606940:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599255.606960:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543271168:0@lo:101: 00000100:00100000:2.0:1787599255.607005:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.607114:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.607183:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543271168 00000100:00100000:1.0:1787599255.607190:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543271168 00000100:00100000:1.0:1787599255.607233:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787599255.607242:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+13:5828:x1874433543271168:12345-0@lo:101: 00010000:00010000:1.0:1787599255.607262:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599255.607275:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d9800/0xa46cbc67411825c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411825ba expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.607624:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d9800/0xa46cbc67411825c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411825ba expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.607637:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d9800/0xa46cbc67411825c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411825ba expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.607646:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9800, rc 0) 00000100:00100000:1.0:1787599255.607895:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543271168:12345-0@lo:101: Request processed in 653us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.607903:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787599255.608196:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543271168:0@lo:101: 00010000:00010000:3.0:1787599255.608227:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.608236:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599255.608581:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543271296:0@lo:501: 00000100:00100000:3.0:1787599255.608620:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599255.608759:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.608797:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543271296 00000100:00100000:1.0:1787599255.608802:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543271296 00000100:00100000:1.0:1787599255.608882:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787599255.608892:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543271296:12345-0@lo:501: 00000100:00100000:1.0:1787599255.609263:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543271296:12345-0@lo:501: Request processed in 371us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.609271:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787599255.609608:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543271296:0@lo:501: 00000100:00100000:3.0:1787599255.609645:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543271424:0@lo:503: 00000100:00100000:3.0:1787599255.609699:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599255.609912:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.609995:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543271424 00000100:00100000:2.0:1787599255.610001:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543271424 00000100:00100000:2.0:1787599255.610039:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787599255.610047:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543271424:12345-0@lo:503: 00000100:00100000:2.0:1787599255.610226:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543271424:12345-0@lo:503: Request processed in 180us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.610233:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787599255.610355:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543271424:0@lo:503: 00000100:00100000:2.0:1787599255.611253:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8445:1874433543271552:0@lo:502: 00000100:00100000:2.0:1787599255.611327:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.611366:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c708499c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599255.611729:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543271552 00000100:00100000:3.0:1787599255.611736:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543271552 00000100:00100000:3.0:1787599255.611778:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787599255.611787:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:8445:x1874433543271552:12345-0@lo:502: 00000100:00100000:3.0:1787599255.611978:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:8445:x1874433543271552:12345-0@lo:502: Request processed in 191us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599255.611985:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787599255.612370:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8445:1874433543271552:0@lo:502: 00000020:01000000:2.0:1787599255.612645:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599255.612655:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599255.612657:0:8445:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787599255.612663:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787599255.612708:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8445:1874433543271680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599255.612764:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.612795:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c708499c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599255.613007:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543271680 00000100:00100000:3.0:1787599255.613014:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543271680 00000100:00100000:3.0:1787599255.613058:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787599255.613066:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:8445:x1874433543271680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599255.616775:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:8445:x1874433543271680:12345-0@lo:502:llog_process_th.0 Request processed in 3700us (4001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599255.616803:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787599255.617122:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8445:1874433543271680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787599255.617177:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599255.617186:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599255.617188:0:8445:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787599255.617193:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787599255.617550:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787599255.617571:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787599255.617581:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.617592:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599255.617613:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787599255.617616:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6c50231800 from 39 10000000:01000000:1.0:1787599255.617619:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787599255.617653:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.617661:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.617669:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599255.617690:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543271808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599255.617740:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599255.617783:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599255.617913:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543271808 00000100:00100000:3.0:1787599255.617921:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543271808 00000100:00100000:3.0:1787599255.617955:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787599255.617965:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:5828:x1874433543271808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599255.617977:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599255.617989:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc67411825cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411825c8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.618013:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc67411825cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411825c8 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.618036:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc67411825cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411825c8 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.618045:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24dc00, rc 0) 00000100:00100000:3.0:1787599255.618091:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543271808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599255.618097:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787599255.618246:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543271808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599255.618260:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.618269:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599255.618338:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543271936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599255.618369:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.618579:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c708499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.618640:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543271936 00000100:00100000:1.0:1787599255.618646:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543271936 00000100:00100000:1.0:1787599255.618669:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787599255.618676:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543271936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599255.618958:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543271936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.618966:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787599255.619192:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543271936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599255.619225:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543272064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599255.619272:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.619477:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c708499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.619530:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543272064 00000100:00100000:1.0:1787599255.619535:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543272064 00000100:00100000:1.0:1787599255.619570:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787599255.619578:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543272064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599255.619718:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543272064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.619730:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787599255.619819:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543272064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599255.630987:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8446:1874433543272192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599255.631109:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599255.631180:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.631327:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543272192 00000100:00100000:1.0:1787599255.631335:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543272192 00000100:00100000:1.0:1787599255.631541:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787599255.631552:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:8446:x1874433543272192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599255.631926:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:8446:x1874433543272192:12345-0@lo:502:llog_process_th.0 Request processed in 372us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.631934:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787599255.632523:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8446:1874433543272192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599255.632590:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8446:1874433543272320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599255.632634:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.632709:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.632788:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543272320 00000100:00100000:2.0:1787599255.632795:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543272320 00000100:00100000:2.0:1787599255.632870:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787599255.632880:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:8446:x1874433543272320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599255.633114:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:8446:x1874433543272320:12345-0@lo:502:llog_process_th.0 Request processed in 236us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.633122:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787599255.635187:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8446:1874433543272320:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787599255.635236:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787599255.635674:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787599255.635702:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787599255.635713:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.635725:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599255.635761:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787599255.635765:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787599255.635767:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787599255.635809:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.635817:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.635828:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599255.635852:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543272448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599255.635913:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599255.635958:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.637558:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543272448 00000100:00100000:1.0:1787599255.637576:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543272448 00000100:00100000:1.0:1787599255.637640:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787599255.637650:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:5828:x1874433543272448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599255.637667:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599255.637683:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d8800/0xa46cbc67411825dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411825d6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.637710:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d8800/0xa46cbc67411825dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411825d6 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.637721:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d8800/0xa46cbc67411825dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411825d6 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.637730:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8800, rc 0) 00000100:00100000:1.0:1787599255.637828:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543272448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.637835:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787599255.638177:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543272448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599255.638196:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599255.638207:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599255.638271:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543272576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599255.638321:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.638350:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.638532:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543272576 00000100:00100000:1.0:1787599255.638543:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543272576 00000100:00100000:1.0:1787599255.638567:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787599255.638573:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543272576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599255.638839:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543272576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.638847:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787599255.639548:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543272576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599255.639594:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543272704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599255.639645:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.639670:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599255.639759:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543272704 00000100:00100000:3.0:1787599255.639766:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543272704 00000100:00100000:3.0:1787599255.639797:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787599255.639804:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543272704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599255.639983:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543272704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599255.639991:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787599255.640617:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543272704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599255.641009:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8447:1874433543272832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599255.641070:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.641107:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.641215:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543272832 00000100:00100000:1.0:1787599255.641220:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543272832 00000100:00100000:1.0:1787599255.641256:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787599255.641265:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:8447:x1874433543272832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599255.641652:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:8447:x1874433543272832:12345-0@lo:502:llog_process_th.0 Request processed in 387us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.641661:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787599255.641839:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8447:1874433543272832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599255.641866:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599255.641874:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599255.641877:0:8447:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787599255.641882:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787599255.641903:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8447:1874433543272960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599255.641937:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.641957:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.642138:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543272960 00000100:00100000:1.0:1787599255.642143:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543272960 00000100:00100000:1.0:1787599255.642584:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787599255.642596:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:8447:x1874433543272960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599255.642806:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:8447:x1874433543272960:12345-0@lo:502:llog_process_th.0 Request processed in 212us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.642814:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787599255.643136:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8447:1874433543272960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599255.643196:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599255.643203:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599255.643206:0:8447:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787599255.643213:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787599255.644134:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787599255.644194:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787599255.644207:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.644219:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599255.644246:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787599255.644250:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6c6dd51000 from 39 10000000:01000000:1.0:1787599255.644253:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787599255.644778:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.644791:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.644805:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599255.644838:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599255.644908:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599255.644995:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599255.647558:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543273088 00000100:00100000:0.0:1787599255.647575:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543273088 00000100:00100000:0.0:1787599255.647634:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787599255.647646:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543273088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599255.647664:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599255.647694:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751fec00/0xa46cbc67411825eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411825e4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599255.647725:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fec00/0xa46cbc67411825eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411825e4 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599255.647769:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751fec00/0xa46cbc67411825eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411825e4 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599255.647779:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fec00, rc 0) 00000100:00100000:0.0:1787599255.647910:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543273088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 266us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599255.647917:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787599255.650707:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599255.650739:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.650762:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599255.651574:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599255.651646:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.651691:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.653185:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543273216 00000100:00100000:2.0:1787599255.653198:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543273216 00000100:00100000:2.0:1787599255.653260:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787599255.653270:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543273216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599255.653805:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543273216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 535us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.653813:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787599255.653937:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599255.653982:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599255.654036:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.654073:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.654709:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543273344 00000100:00100000:2.0:1787599255.654719:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543273344 00000100:00100000:2.0:1787599255.654782:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787599255.654791:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543273344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599255.654976:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543273344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.654984:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787599255.655130:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599255.655774:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f85c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8448:1874433543273472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599255.655823:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599255.655858:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.656519:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543273472 00000100:00100000:2.0:1787599255.656529:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543273472 00000100:00100000:2.0:1787599255.656585:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787599255.656595:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:8448:x1874433543273472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599255.656894:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:8448:x1874433543273472:12345-0@lo:502:llog_process_th.0 Request processed in 299us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.656902:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787599255.662100:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f85c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8448:1874433543273472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599255.662460:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8448:1874433543273600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599255.662557:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.662702:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.663099:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543273600 00000100:00100000:1.0:1787599255.663107:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543273600 00000100:00100000:2.0:1787599255.667554:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787599255.667583:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:8448:x1874433543273600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599255.667930:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:8448:x1874433543273600:12345-0@lo:502:llog_process_th.0 Request processed in 361us (5373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.667938:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787599255.669383:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8448:1874433543273600:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787599255.669438:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787599255.669547:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787599255.669570:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599255.669582:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.669596:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599255.669607:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787599255.669609:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787599255.669624:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787599255.669661:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.669669:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.669678:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599255.669702:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599255.669774:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.669822:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.669871:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543273728 00000100:00100000:1.0:1787599255.669879:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543273728 00000100:00100000:1.0:1787599255.669934:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787599255.669946:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543273728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599255.669961:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599255.669975:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411825f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411825f2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.670001:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411825f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411825f2 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.670012:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411825f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411825f2 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599255.670144:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8c00, rc 0) 00000100:00100000:1.0:1787599255.670215:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543273728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.670223:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787599255.670334:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599255.670348:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.670358:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599255.670529:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599255.670557:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599255.670572:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.670626:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543273856 00000100:00100000:1.0:1787599255.670630:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543273856 00000100:00100000:1.0:1787599255.670663:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787599255.670670:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543273856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599255.671475:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543273856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 800us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599255.671486:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787599255.673552:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599255.673886:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599255.673982:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599255.674145:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.674370:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543273984 00000100:00100000:2.0:1787599255.677846:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543273984 00000100:00100000:2.0:1787599255.677999:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787599255.678013:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543273984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599255.678708:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543273984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 696us (4723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.678718:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787599255.679246:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543273984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599255.680144:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8449:1874433543274112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599255.680475:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.680557:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855180 going to sleep for 11 seconds 00000100:00100000:3.0:1787599255.680609:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543274112 00000100:00100000:3.0:1787599255.680617:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543274112 00000100:00100000:3.0:1787599255.680800:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787599255.680811:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8449:x1874433543274112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599255.681284:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8449:x1874433543274112:12345-0@lo:502:llog_process_th.0 Request processed in 474us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599255.681366:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787599255.681523:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8449:1874433543274112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599255.681558:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599255.681567:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599255.681570:0:8449:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787599255.681576:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787599255.681607:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8449:1874433543274240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599255.681645:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599255.681929:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.681968:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543274240 00000100:00100000:2.0:1787599255.681974:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543274240 00000100:00100000:2.0:1787599255.682132:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787599255.682142:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8449:x1874433543274240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599255.682418:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8449:x1874433543274240:12345-0@lo:502:llog_process_th.0 Request processed in 277us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.682426:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787599255.682517:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8449:1874433543274240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599255.682543:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599255.682549:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599255.682550:0:8449:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787599255.682555:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787599255.683263:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787599255.683285:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787599255.683306:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.683318:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599255.683328:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787599255.683331:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f6c50f78000 from 1 10000000:01000000:3.0:1787599255.683334:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787599255.683479:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ca00/0xa46cbc6741182600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.683488:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ca00/0xa46cbc6741182600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.683499:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ca00/0xa46cbc6741182600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599255.683519:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543274368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599255.683566:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599255.684108:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543274368 00000100:00100000:1.0:1787599255.684117:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543274368 00000100:00100000:3.0:1787599255.684228:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599255.684564:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787599255.684575:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543274368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599255.684588:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599255.684604:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75618800/0xa46cbc6741182607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182600 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.684628:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75618800/0xa46cbc6741182607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182600 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.684638:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75618800/0xa46cbc6741182607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182600 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599255.684648:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618800, rc 0) 00000100:00100000:2.0:1787599255.684889:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543274368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 314us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599255.684897:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787599255.685127:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543274368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599255.685143:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ca00/0xa46cbc6741182600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182607 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.685262:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ca00/0xa46cbc6741182600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182607 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599255.685483:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543274496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599255.685527:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599255.685606:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599255.685648:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543274496 00000100:00100000:1.0:1787599255.685654:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543274496 00000100:00100000:1.0:1787599255.685870:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787599255.685880:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543274496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599255.686540:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543274496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 660us (1011us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599255.686548:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787599255.686630:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543274496:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787599255.686660:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787599255.686669:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ca00/0xa46cbc6741182600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182607 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599255.686693:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ca00/0xa46cbc6741182600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182607 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.545750:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787599256.960898:0:8486:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc27d4aa60 20000000:00000080:3.0:1787599256.960917:0:8486:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f6c759d4800 uarg=0000000000000000 20000000:01000000:3.0:1787599256.960953:0:8486:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787599256.960959:0:8486:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787599256.960964:0:8486:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787599256.962352:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787599256.962693:0:8486:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787599256.968744:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787599256.968828:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787599256.968961:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787599256.969354:0:8486:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787599256.969381:0:8486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.969400:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c5b24c800/0xa46cbc6741182383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118237c expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.969408:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c40031000/0xa46cbc67411823e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411823de expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.969415:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c582d8400/0xa46cbc67411824b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411824a9 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.969424:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c5b24d800/0xa46cbc674118256d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070b0 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.969432:0:8486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.969472:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c5b24d800/0xa46cbc674118256d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070b0 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.969489:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c5b24d800/0xa46cbc674118256d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070b0 expref: 9 pid: 5826 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.969505:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1874433543274624:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599256.969738:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c582d8400/0xa46cbc67411824b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411824a9 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.969746:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c582d8400/0xa46cbc67411824b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411824a9 expref: 18 pid: 5824 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.969766:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1874433543274752:0@lo:104: 00000100:00100000:1.0:1787599256.969807:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599256.969871:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c40031000/0xa46cbc67411823e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411823de expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.969880:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c40031000/0xa46cbc67411823e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411823de expref: 18 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.969888:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1874433543274880:0@lo:104: 00000100:00100000:1.0:1787599256.969911:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599256.969987:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c5b24c800/0xa46cbc6741182383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc674118237c expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.969995:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c5b24c800/0xa46cbc6741182383 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc674118237c expref: 18 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.970262:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1874433543275008:0@lo:104: 00000100:00100000:1.0:1787599256.970440:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599256.970946:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787599256.970968:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599256.971116:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543274752 00000100:00100000:0.0:1787599256.971123:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543274752 00000100:00100000:0.0:1787599256.971197:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543274880 00000100:00100000:0.0:1787599256.971201:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543274880 00000100:00100000:0.0:1787599256.971213:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543275008 00000100:00100000:0.0:1787599256.971215:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543275008 00000100:00100000:0.0:1787599256.971228:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787599256.971237:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:8486:x1874433543274752:12345-0@lo:104: 00010000:00010000:0.0:1787599256.971251:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599256.971450:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599256.971456:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:8486:x1874433543274752:12345-0@lo:104: Request processed in 221us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599256.971473:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787599256.971492:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787599256.971498:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74c89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:8486:x1874433543274880:12345-0@lo:104: 00010000:00010000:0.0:1787599256.971506:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599256.971538:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787599256.971542:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74c89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:8486:x1874433543274880:12345-0@lo:104: Request processed in 46us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599256.971547:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787599256.971594:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787599256.971601:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:8486:x1874433543275008:12345-0@lo:104: 00010000:00010000:0.0:1787599256.971609:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc674118237c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599256.971633:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787599256.971637:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:8486:x1874433543275008:12345-0@lo:104: Request processed in 38us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599256.971642:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787599256.971710:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787599256.971717:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.971734:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030000 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599256.971738:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.971746:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599256.971765:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599256.971771:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599256.971812:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.971818:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599256.971839:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.971845:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc67411824a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411824b0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.971860:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599256.971863:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.971868:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599256.971871:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.971877:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599256.971883:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599256.971888:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599256.971910:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.971916:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599256.972468:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.972477:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc67411823de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411823e5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.972487:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599256.972490:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc674118237c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.972495:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c600 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599256.972498:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc674118237c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.972504:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc674118237c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599256.972509:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc674118237c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599256.972513:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599256.972529:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc674118237c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.972535:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599256.972552:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc674118237c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.972568:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc674118237c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182383 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.972583:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599256.972585:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599256.972587:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599256.972596:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599256.972610:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543275136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599256.972652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599256.972687:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599256.972692:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543275264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599256.972713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599256.972751:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543275392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599256.972774:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599256.972804:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543275136 00000100:00100000:1.0:1787599256.972809:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543275136 00010000:00010000:1.0:1787599256.972832:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c582d8400/0xa46cbc67411824b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411824a9 expref: 19 pid: 5824 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.972857:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543275264 00000100:00100000:1.0:1787599256.972859:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543275264 00010000:00010000:1.0:1787599256.972869:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c40031000/0xa46cbc67411823e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411823de expref: 20 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.972878:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543275392 00000100:00100000:1.0:1787599256.972881:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543275392 00010000:00010000:1.0:1787599256.972890:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c5b24c800/0xa46cbc6741182383 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118237c expref: 21 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.972915:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599256.974500:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+21:3301:x1874433543275136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599256.974525:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599256.974535:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c582d8400/0xa46cbc67411824b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411824a9 expref: 21 pid: 5824 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.974549:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c582d8400/0xa46cbc67411824b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411824a9 expref: 21 pid: 5824 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.974569:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599256.974626:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+21:3301:x1874433543275136:12345-0@lo:103:ldlm_bl.0 Request processed in 1704us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599256.974634:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599256.974662:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599256.974671:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+20:3301:x1874433543275264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599256.974677:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599256.974682:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c40031000/0xa46cbc67411823e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411823de expref: 20 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.974690:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c40031000/0xa46cbc67411823e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411823de expref: 20 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.974699:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599256.974715:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+20:3301:x1874433543275264:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599256.974732:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599256.974743:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599256.974760:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543275392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599256.974767:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599256.974771:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c5b24c800/0xa46cbc6741182383 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118237c expref: 19 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.974779:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c5b24c800/0xa46cbc6741182383 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc674118237c expref: 19 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.974788:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599256.974812:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543275392:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599256.974817:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599256.974861:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543275392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599256.974890:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543275264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599256.974898:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543275136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599256.976227:0:8486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d8400/0xa46cbc67411824b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411824a9 expref: 18 pid: 5824 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.976243:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1874433543274752:0@lo:104: 00010000:00010000:1.0:1787599256.976261:0:8486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c40031000/0xa46cbc67411823e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411823de expref: 17 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.976477:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1874433543274880:0@lo:104: 00010000:00010000:1.0:1787599256.976491:0:8486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24c800/0xa46cbc6741182383 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc674118237c expref: 16 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.976499:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1874433543275008:0@lo:104: 00000100:00100000:1.0:1787599256.983826:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1874433543274624:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599256.983869:0:8486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599256.989537:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599256.989653:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522275968 00000100:00100000:1.0:1787599256.989665:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522275968 00010000:00010000:1.0:1787599256.989706:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c5b24d800/0xa46cbc674118256d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070b0 expref: 10 pid: 5826 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599256.989877:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1787599256.989889:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2359:x1874433522275968:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599256.989905:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599256.989912:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c5b24d800/0xa46cbc674118256d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070b0 expref: 10 pid: 5826 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.989926:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c5b24d800/0xa46cbc674118256d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070b0 expref: 10 pid: 5826 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.989946:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24d800/0xa46cbc674118256d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070b0 expref: 10 pid: 5826 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.989963:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.989972:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.989991:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.990017:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.990025:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.990032:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.990039:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8a00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599256.990044:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.990053:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.990074:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599256.990085:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599256.990190:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:2359:x1874433522275968:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 303us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599256.990198:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00010000:00010000:3.0:1787599256.990253:0:8486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599256.990262:0:8486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599256.990528:0:8486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d8a00/0xa46cbc674118260e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599257.290838:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599257.290985:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522276096 00000100:00100000:0.0:1787599257.290996:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522276096 00000100:00100000:0.0:1787599257.291058:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 172 00000100:00100000:0.0:1787599257.291070:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:5598:x1874433522276096:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599257.291099:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599257.291125:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751fea00/0xa46cbc6741182615 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e070ef expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599257.291220:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fea00/0xa46cbc6741182615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070ef expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599257.291231:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751fea00/0xa46cbc6741182615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070ef expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599257.291241:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fea00, rc 0) 00000100:00100000:0.0:1787599257.291301:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5598:x1874433522276096:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 233us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599257.291308:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 172 00000100:00100000:0.0:1787599257.301726:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599257.301846:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522276224 00000100:00100000:1.0:1787599257.301857:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522276224 00000100:00100000:1.0:1787599257.301920:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 173 00000100:00100000:1.0:1787599257.301931:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5598:x1874433522276224:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599257.302304:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5598:x1874433522276224:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 374us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599257.302319:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 173 00000100:00100000:3.0:1787599257.314294:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599257.316610:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522276352 00000100:00100000:2.0:1787599257.316641:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522276352 00000100:00100000:2.0:1787599257.316724:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:2.0:1787599257.316738:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5598:x1874433522276352:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599257.316980:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:5598:x1874433522276352:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 245us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599257.316989:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:3.0:1787599257.331761:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599257.331975:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522276480 00000100:00100000:1.0:1787599257.331990:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522276480 00000100:00100000:1.0:1787599257.332069:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:1.0:1787599257.332080:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:6118:x1874433522276480:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599257.332492:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:6118:x1874433522276480:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 412us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599257.332500:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:3.0:1787599257.338361:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599257.338688:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522276608 00000100:00100000:0.0:1787599257.338704:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522276608 00000100:00100000:0.0:1787599257.339421:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 176 00000100:00100000:0.0:1787599257.339436:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:6118:x1874433522276608:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787599257.339840:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:6118:x1874433522276608:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 406us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599257.339850:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 176 00010000:00010000:2.0:1787599257.571277:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787599258.337302:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599258.337311:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6b4432d000 from 4 10000000:01000000:0.0:1787599258.337317:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599258.337368:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599258.337382:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599258.337420:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599258.337447:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543275520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599258.337519:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599258.337576:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58e46480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599258.337723:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543275520 00000100:00100000:1.0:1787599258.337732:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543275520 00000100:00100000:1.0:1787599258.337788:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787599258.337799:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543275520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599258.337812:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599258.337825:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d8e00/0xa46cbc6741182623 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118261c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.337848:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d8e00/0xa46cbc6741182623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118261c expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.337859:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d8e00/0xa46cbc6741182623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118261c expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.337869:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8e00, rc 0) 00000100:00100000:1.0:1787599258.337913:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543275520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.337920:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787599258.337979:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543275520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599258.337993:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.338003:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599258.338055:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543275648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.338187:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599258.338209:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599258.338222:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543275648 00000100:00100000:1.0:1787599258.338226:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543275648 00000100:00100000:1.0:1787599258.338247:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787599258.338253:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543275648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.338494:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543275648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.338501:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787599258.338532:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543275648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.338560:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543275776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.338596:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599258.338609:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe980c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599258.338620:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543275776 00000100:00100000:1.0:1787599258.338623:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543275776 00000100:00100000:1.0:1787599258.338642:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787599258.338648:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543275776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.338794:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543275776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.338806:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787599258.338839:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543275776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.338991:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8555:1874433543275904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599258.339023:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599258.339039:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543275904 00000100:00100000:1.0:1787599258.339043:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543275904 00000100:00100000:1.0:1787599258.339061:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787599258.339080:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:8555:x1874433543275904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599258.339222:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:8555:x1874433543275904:12345-0@lo:502:llog_process_th.0 Request processed in 154us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.339229:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787599258.339261:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599258.339272:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8555:1874433543275904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599258.339291:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599258.339300:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599258.339302:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787599258.339309:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6b4432d000 00000020:00000080:1.0:1787599258.339311:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787599258.339386:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8555:1874433543276032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599258.339420:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599258.339448:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599258.340267:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543276032 00000100:00100000:0.0:1787599258.340275:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543276032 00000100:00100000:0.0:1787599258.340310:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787599258.340319:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:8555:x1874433543276032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599258.340499:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:8555:x1874433543276032:12345-0@lo:502:llog_process_th.0 Request processed in 182us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599258.340507:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787599258.343923:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8555:1874433543276032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599258.343968:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599258.343977:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599258.343979:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787599258.343990:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787599258.344470:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787599258.344493:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599258.344504:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599258.344517:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599258.344607:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599258.344611:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c50231800 from 4 10000000:01000000:3.0:1787599258.344614:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599258.344658:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599258.344665:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599258.344676:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599258.344722:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543276160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599258.344790:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599258.344876:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7004ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599258.344911:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543276160 00000100:00100000:2.0:1787599258.344919:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543276160 00000100:00100000:2.0:1787599258.345004:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787599258.345015:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543276160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599258.345030:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599258.345043:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75618e00/0xa46cbc6741182631 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118262a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599258.345081:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75618e00/0xa46cbc6741182631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118262a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599258.345092:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75618e00/0xa46cbc6741182631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118262a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599258.345115:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618e00, rc 0) 00000100:00100000:2.0:1787599258.345201:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543276160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599258.345208:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787599258.345298:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543276160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599258.345313:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599258.345323:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599258.345380:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543276288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599258.345413:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599258.345681:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7004ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599258.345726:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543276288 00000100:00100000:1.0:1787599258.345731:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543276288 00000100:00100000:1.0:1787599258.345758:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787599258.345765:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543276288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.346024:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543276288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.346032:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787599258.346302:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543276288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.346337:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543276416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.346375:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599258.346397:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599258.346407:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543276416 00000100:00100000:1.0:1787599258.346411:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543276416 00000100:00100000:1.0:1787599258.346428:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787599258.346434:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543276416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.346571:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543276416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.346578:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787599258.346610:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543276416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.346781:0:8557:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8557:1874433543276544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599258.346812:0:8557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599258.346829:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543276544 00000100:00100000:1.0:1787599258.346833:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543276544 00000100:00100000:1.0:1787599258.346849:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787599258.346855:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8557:x1874433543276544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599258.346967:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8557:x1874433543276544:12345-0@lo:502:llog_process_th.0 Request processed in 111us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.346974:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787599258.346999:0:8557:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599258.347010:0:8557:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8557:1874433543276544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599258.347030:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599258.347038:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599258.347041:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787599258.347047:0:8557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6c50231800 00000020:00000080:1.0:1787599258.347049:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787599258.347677:0:8557:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8557:1874433543276672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599258.347731:0:8557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599258.347758:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543276672 00000100:00100000:1.0:1787599258.347763:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543276672 00000100:00100000:1.0:1787599258.347785:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787599258.347792:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8557:x1874433543276672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599258.347921:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:8557:x1874433543276672:12345-0@lo:502:llog_process_th.0 Request processed in 129us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.347928:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787599258.347958:0:8557:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599258.347972:0:8557:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8557:1874433543276672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599258.347995:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599258.348000:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599258.348001:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787599258.348004:0:8557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787599258.348051:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787599258.348254:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787599258.348264:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.348274:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599258.348283:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787599258.348285:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c6dd51000 from 4 10000000:01000000:1.0:1787599258.348288:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787599258.348309:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.348317:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.348326:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599258.348339:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543276800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.348365:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599258.348379:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599258.348391:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543276800 00000100:00100000:1.0:1787599258.348395:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543276800 00000100:00100000:1.0:1787599258.348413:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787599258.348420:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543276800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599258.348429:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599258.348440:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d9600/0xa46cbc674118263f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182638 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.348473:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d9600/0xa46cbc674118263f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182638 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.348485:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d9600/0xa46cbc674118263f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182638 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.348493:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9600, rc 0) 00000100:00100000:1.0:1787599258.348523:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543276800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.348529:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787599258.348558:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543276800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599258.348570:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.348578:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599258.348616:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543276928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.348640:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599258.348653:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599258.348664:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543276928 00000100:00100000:1.0:1787599258.348667:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543276928 00000100:00100000:1.0:1787599258.348685:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787599258.348691:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543276928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.351570:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543276928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2869us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.351595:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787599258.351668:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543276928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.351737:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543277056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599258.351785:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599258.351827:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599258.351857:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543277056 00000100:00100000:0.0:1787599258.351866:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543277056 00000100:00100000:0.0:1787599258.351913:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787599258.351924:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543277056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599258.352107:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543277056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599258.352114:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787599258.355422:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543277056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599258.356095:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8559:1874433543277184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599258.356214:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599258.356251:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543277184 00000100:00100000:0.0:1787599258.356256:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c756143c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599258.356259:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543277184 00000100:00100000:3.0:1787599258.356312:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787599258.356323:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:8559:x1874433543277184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599258.356545:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:8559:x1874433543277184:12345-0@lo:502:llog_process_th.0 Request processed in 222us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599258.356553:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787599258.356592:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8559:1874433543277184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599258.356619:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599258.356632:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599258.356635:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787599258.356643:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6c6dd51000 00000020:00000080:0.0:1787599258.356646:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787599258.356733:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8559:1874433543277312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599258.363084:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599258.363143:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c756143c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599258.363187:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543277312 00000100:00100000:3.0:1787599258.363197:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543277312 00000100:00100000:3.0:1787599258.363250:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787599258.363261:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c5843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:8559:x1874433543277312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599258.363520:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c5843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:8559:x1874433543277312:12345-0@lo:502:llog_process_th.0 Request processed in 260us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599258.363535:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787599258.364893:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:8559:1874433543277312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599258.364931:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599258.364940:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599258.364944:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787599258.364950:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787599258.365061:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787599258.365094:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599258.365107:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599258.365117:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599258.593415:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599258.657729:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599258.657755:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543277440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599258.657832:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599258.657946:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543277440 00000100:00100000:0.0:1787599258.657955:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543277440 00000100:00100000:0.0:1787599258.658043:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787599258.658055:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543277440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599258.658094:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599258.658153:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543277440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599258.658184:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787599258.658337:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760eed80 x1874433543277440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599258.658361:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543277440:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787599258.658595:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599258.755287:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599258.755331:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599258.755352:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599258.755372:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599258.755400:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522276992 00000100:00100000:0.0:1787599258.755411:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522276992 00000100:00100000:0.0:1787599258.755470:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522277120 00000100:00100000:0.0:1787599258.755474:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522277120 00000100:00100000:0.0:1787599258.755494:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1787599258.755512:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522276992:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599258.755587:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522276992:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 76us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599258.755594:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1787599258.755611:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:0.0:1787599258.755618:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522277120:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599258.755643:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522277120:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599258.755649:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00080000:0.0:1787599258.755665:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599258.755669:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599258.756898:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522276736 00000100:00100000:1.0:1787599258.756910:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522276736 00000100:00100000:1.0:1787599258.756962:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 192 00000100:00100000:1.0:1787599258.756972:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522276736:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599258.757025:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522276736:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 55us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.757032:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 192 00000100:00100000:1.0:1787599258.757065:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522276864 00000100:00100000:1.0:1787599258.757069:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522276864 00000100:00100000:1.0:1787599258.757119:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:1.0:1787599258.757126:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522276864:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599258.757176:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522276864:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599258.757183:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00080000:1.0:1787599258.757557:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787599259.617348:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599260.641323:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599260.709867:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543277568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599260.709965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599260.710008:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543277952:0@lo:400:kworker.0 00000100:00100000:1.0:1787599260.710025:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543278080:0@lo:400:kworker.0 00000100:00100000:0.0:1787599260.710040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599260.710046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599260.710061:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787599260.710061:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787599260.710067:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543277696:0@lo:400:kworker.0 00000100:00100000:0.0:1787599260.710067:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543277824:0@lo:400:kworker.0 00000100:00100000:1.0:1787599260.710090:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599260.710090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599260.710105:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543278336:0@lo:400:kworker.0 00000100:00100000:1.0:1787599260.710110:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543278208:0@lo:400:kworker.0 00000100:00100000:0.0:1787599260.710123:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599260.710126:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599260.710148:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543277952 00000100:00100000:1.0:1787599260.710149:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543277568 00000100:00100000:1.0:1787599260.710172:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543277568 00000100:00100000:0.0:1787599260.710176:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543277952 00000100:00100000:0.0:1787599260.710288:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543277824 00000100:00100000:0.0:1787599260.710293:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543277824 00000100:00100000:0.0:1787599260.710306:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543278208 00000100:00100000:0.0:1787599260.710309:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543278208 00000100:00100000:1.0:1787599260.714871:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599260.714889:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543277568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599260.715044:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599260.715136:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543277568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 253us (5170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599260.715144:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599260.715193:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543278080 00000100:00100000:1.0:1787599260.715201:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543278080 00000100:00100000:1.0:1787599260.715237:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543278336 00000100:00100000:1.0:1787599260.715240:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543278336 00000100:00100000:1.0:1787599260.715253:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599260.715259:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543278080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599260.715294:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543278080:12345-0@lo:400:kworker.0 Request processed in 36us (5247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599260.715301:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599260.715311:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599260.715317:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543278336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599260.715360:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543278336:12345-0@lo:400:kworker.0 Request processed in 43us (5236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599260.715367:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599260.715385:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543277696 00000100:00100000:1.0:1787599260.715389:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543277696 00000100:00100000:1.0:1787599260.715411:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787599260.715417:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543277696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599260.715446:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543277696:12345-0@lo:400:kworker.0 Request processed in 29us (5354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599260.715452:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787599260.715481:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787599260.715489:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543277952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599260.715518:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543277952:12345-0@lo:400:kworker.0 Request processed in 30us (5478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599260.715524:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787599260.715538:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599260.715544:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543277824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599260.715570:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543277824:12345-0@lo:400:kworker.0 Request processed in 26us (5479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599260.715575:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787599260.715590:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599260.715594:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599260.715598:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599260.715643:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543277824:0@lo:400:kworker.0 00010000:00080000:1.0:1787599260.715675:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fe20e00 x1874433543278336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599260.715698:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543278336:0@lo:400:kworker.0 00000100:00100000:1.0:1787599260.715712:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543277952:0@lo:400:kworker.0 00000100:00100000:1.0:1787599260.715749:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543277696:0@lo:400:kworker.0 00010000:00080000:1.0:1787599260.715760:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fe23100 x1874433543278080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599260.715770:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543278080:0@lo:400:kworker.0 00010000:00080000:1.0:1787599260.715779:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760ed180 x1874433543277568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599260.715792:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543277568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599260.716217:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599260.716227:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543278208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599260.716279:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543278208:12345-0@lo:400:kworker.0 Request processed in 55us (6151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599260.716287:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787599260.719077:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543278208:0@lo:400:kworker.0 00010000:00010000:2.0:1787599261.665318:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599262.693536:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787599263.355571:0:8786:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787599263.714630:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599263.777440:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599263.777476:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543278464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599263.777579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599263.777723:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543278464 00000100:00100000:1.0:1787599263.777735:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543278464 00000100:00100000:1.0:1787599263.778451:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599263.778465:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543278464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599263.778518:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599263.778600:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543278464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599263.778609:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787599263.778677:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787599263.778717:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760ed180 x1874433543278464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599263.778747:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543278464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599263.878767:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599263.878814:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599263.878848:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599263.878888:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599263.878926:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522277504 00000100:00100000:0.0:1787599263.878939:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522277504 00000100:00100000:0.0:1787599263.879026:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522277632 00000100:00100000:0.0:1787599263.879029:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522277632 00000100:00100000:0.0:1787599263.879053:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1787599263.879065:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522277504:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599263.879202:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522277504:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 128us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599263.879218:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1787599263.879673:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:0.0:1787599263.879684:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522277632:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599263.879723:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522277632:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 42us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599263.879730:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:0.0:1787599263.879757:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522277376 00000100:00100000:0.0:1787599263.879763:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522277376 00000100:00100000:0.0:1787599263.879816:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:0.0:1787599263.879825:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522277376:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599263.879869:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522277376:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 34us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599263.879893:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00080000:0.0:1787599263.880080:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599263.880086:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599263.880089:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599263.881254:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522277248 00000100:00100000:3.0:1787599263.881278:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522277248 00000100:00100000:3.0:1787599263.881340:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 194 00000100:00100000:3.0:1787599263.881351:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522277248:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599263.881452:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522277248:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 104us (2699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599263.881460:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 194 00010000:00010000:1.0:1787599264.740120:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599265.769754:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599265.825708:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543278592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599265.825817:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599265.825900:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543278592 00000100:00100000:3.0:1787599265.825908:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543278592 00000100:00100000:3.0:1787599265.825962:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787599265.825973:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543278592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599265.826007:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599265.826052:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543278592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599265.826069:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787599265.826091:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787599265.826119:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760efb80 x1874433543278592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599265.826137:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543278592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599265.826415:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543278848:0@lo:400:kworker.0 00000100:00100000:3.0:1787599265.826442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599265.826464:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599265.826470:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543278976:0@lo:400:kworker.0 00000100:00100000:3.0:1787599265.826491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599265.826521:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543278848 00000100:00100000:3.0:1787599265.826526:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543278848 00000100:00100000:3.0:1787599265.826562:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543278976 00000100:00100000:3.0:1787599265.826566:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543278976 00000100:00100000:3.0:1787599265.826593:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787599265.826600:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543278848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599265.826638:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543278848:12345-0@lo:400:kworker.0 Request processed in 38us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599265.826645:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787599265.826657:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599265.826664:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543278976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599265.826691:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543278976:12345-0@lo:400:kworker.0 Request processed in 28us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599265.826697:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787599265.826718:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599265.826744:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543278976:0@lo:400:kworker.0 00000100:00100000:3.0:1787599265.826755:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543278848:0@lo:400:kworker.0 00000100:00100000:3.0:1787599265.826776:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543279104:0@lo:400:kworker.0 00000100:00100000:3.0:1787599265.826803:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599265.826960:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543278720:0@lo:400:kworker.0 00000100:00100000:0.0:1787599265.826997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599265.827023:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543279232:0@lo:400:kworker.0 00000100:00100000:0.0:1787599265.827042:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599265.827099:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543279104 00000100:00100000:3.0:1787599265.827104:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543279104 00000100:00100000:3.0:1787599265.827145:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787599265.827153:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543279104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599265.827212:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543279104:12345-0@lo:400:kworker.0 Request processed in 60us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599265.827218:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787599265.827235:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543279232 00000100:00100000:3.0:1787599265.827239:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543279232 00000100:00100000:3.0:1787599265.827261:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599265.827266:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543279232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599265.827298:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543279232:12345-0@lo:400:kworker.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599265.827303:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787599265.827411:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599265.827414:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599265.827442:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543279232:0@lo:400:kworker.0 00010000:00080000:3.0:1787599265.827471:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c74f86300 x1874433543279104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599265.827481:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543279104:0@lo:400:kworker.0 00000100:00100000:1.0:1787599265.832800:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543278720 00000100:00100000:1.0:1787599265.832816:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543278720 00000100:00100000:1.0:1787599265.832993:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787599265.833011:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543278720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599265.833264:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543278720:12345-0@lo:400:kworker.0 Request processed in 145us (6156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599265.833273:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787599265.837981:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543278720:0@lo:400:kworker.0 00010000:00010000:3.0:1787599266.785343:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599267.811883:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599268.834356:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599268.898371:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543279360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599268.898515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599268.898661:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543279360 00000100:00100000:1.0:1787599268.898669:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543279360 00000100:00100000:1.0:1787599268.898740:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599268.898751:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543279360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599268.898796:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599268.898847:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543279360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599268.898855:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787599268.899035:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760efb80 x1874433543279360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599268.899072:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543279360:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787599268.899192:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599268.998972:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599268.999070:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599268.999104:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522277888 00000100:00100000:3.0:1787599268.999114:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522277888 00000100:00100000:0.0:1787599268.999279:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522277760 00000100:00100000:0.0:1787599268.999284:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522277760 00000100:00100000:0.0:1787599268.999323:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 196 00000100:00100000:0.0:1787599268.999335:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2357:x1874433522277760:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599268.999405:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2357:x1874433522277760:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 72us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599268.999413:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 196 00000100:00080000:0.0:1787599268.999443:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599268.999681:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:3.0:1787599268.999691:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522277888:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599268.999735:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522277888:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 47us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599268.999742:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:2.0:1787599269.002318:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599269.002355:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599269.002383:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522278016 00000100:00100000:2.0:1787599269.002393:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522278016 00000100:00100000:2.0:1787599269.002445:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522278144 00000100:00100000:2.0:1787599269.002448:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522278144 00000100:00100000:2.0:1787599269.002553:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:2.0:1787599269.002565:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2355:x1874433522278016:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:2.0:1787599269.002602:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc674118257b 00000100:00080000:2.0:1787599269.002612:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9f6c70856800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599269.002652:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787599269.002985:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+2:2355:x1874433522278016:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 421us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599269.002993:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:2.0:1787599269.003009:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:2.0:1787599269.003016:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2355:x1874433522278144:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:2.0:1787599269.003029:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182582 00000100:00080000:2.0:1787599269.003036:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9f6c81f31800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599269.003057:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1787599269.005313:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787599269.005332:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599269.005337:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787599269.005611:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599269.005980:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+2:2355:x1874433522278144:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 2957us (3617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599269.005993:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000001:02000400:1.0:1787599269.095913:0:9030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing yml_node 00010000:00010000:3.0:1787599269.858520:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599270.881414:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599270.945450:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543279616:0@lo:400:kworker.0 00000100:00100000:0.0:1787599270.945506:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543279488:0@lo:400:kworker.0 00000100:00100000:3.0:1787599270.945552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599270.945554:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599270.945645:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543279744:0@lo:400:kworker.0 00000100:00100000:2.0:1787599270.945707:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543279872:0@lo:400:kworker.0 00000100:00100000:0.0:1787599270.957950:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543280000:0@lo:400:kworker.0 00000100:00100000:0.0:1787599270.958017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599270.958086:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543279616 00000100:00100000:0.0:1787599270.958094:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543279616 00000100:00100000:0.0:1787599270.958146:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543280000 00000100:00100000:0.0:1787599270.958150:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543280000 00000100:00100000:0.0:1787599270.958194:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787599270.958203:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543279616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599270.958256:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543279616:12345-0@lo:400:kworker.0 Request processed in 53us (12703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599270.958263:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787599270.958280:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599270.958287:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543280000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599270.958319:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543280000:12345-0@lo:400:kworker.0 Request processed in 33us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599270.958325:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599270.958441:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543280000:0@lo:400:kworker.0 00000100:00100000:0.0:1787599270.958496:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543279488 00000100:00100000:0.0:1787599270.958501:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543279488 00000100:00100000:0.0:1787599270.958528:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787599270.958536:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543279488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599270.958800:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543279488:12345-0@lo:400:kworker.0 Request processed in 265us (13244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599270.958807:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787599270.958860:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543279488:0@lo:400:kworker.0 00000100:00080000:0.0:1787599270.958888:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599270.960178:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599270.960223:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543280256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599270.960263:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599270.960305:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543280256 00000100:00100000:1.0:1787599270.960311:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543280256 00000100:00100000:1.0:1787599270.960354:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599270.960362:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543280256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599270.960394:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599270.960430:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543280256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599270.960466:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787599270.960487:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787599270.960510:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760ed180 x1874433543280256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599270.960528:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543280256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599270.960689:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543279744 00000100:00100000:0.0:1787599270.960693:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543279744 00000100:00100000:0.0:1787599270.960732:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599270.960748:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543279744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599270.960788:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543279744:12345-0@lo:400:kworker.0 Request processed in 42us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599270.960794:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787599270.962394:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599270.962446:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543279744:0@lo:400:kworker.0 00000100:00100000:2.0:1787599270.965760:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599270.966136:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543279616:0@lo:400:kworker.0 00000100:00100000:3.0:1787599270.966273:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543280128:0@lo:400:kworker.0 00000100:00100000:3.0:1787599270.966319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599270.966673:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543279872 00000100:00100000:1.0:1787599270.966682:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543279872 00000100:00100000:1.0:1787599270.966750:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543280128 00000100:00100000:1.0:1787599270.966753:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543280128 00000100:00100000:1.0:1787599270.966769:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599270.966778:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543279872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599270.966833:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543279872:12345-0@lo:400:kworker.0 Request processed in 56us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599270.966840:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599270.966855:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599270.966861:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543280128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599270.966890:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543280128:12345-0@lo:400:kworker.0 Request processed in 29us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599270.966895:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787599270.966966:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787599270.966993:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c74f87800 x1874433543279872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599270.967004:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543279872:0@lo:400:kworker.0 00010000:00080000:3.0:1787599270.967178:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c74f85180 x1874433543280128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599270.967188:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543280128:0@lo:400:kworker.0 00000001:00100000:2.0:1787599271.494279:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:2.0:1787599271.494290:0:6704:0:(genops.c:885:class_export_put()) final put ffff9f6b4432f000/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:3.0:1787599271.494362:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b4432f000/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 for lustre-OST0000 00000020:00000080:3.0:1787599271.494414:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c70856800 for lustre-OST0000 00010000:00010000:3.0:1787599271.907106:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599272.935100:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787599273.041534:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:0.0:1787599273.041544:0:7625:0:(genops.c:885:class_export_put()) final put ffff9f6c81f35800/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:1.0:1787599273.041613:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c81f35800/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 for lustre-OST0001 00000020:00000080:1.0:1787599273.041663:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c81f31800 for lustre-OST0001 00010000:00010000:1.0:1787599273.955236:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787599273.972681:0:9224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00000100:00100000:1.0:1787599274.017835:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599274.017859:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543280384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599274.017946:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599274.018020:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543280384 00000100:00100000:1.0:1787599274.018028:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543280384 00000100:00100000:1.0:1787599274.018083:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599274.018093:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543280384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599274.018130:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599274.018221:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543280384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599274.018229:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787599274.018277:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760ed180 x1874433543280384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599274.018300:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543280384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787599274.018492:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599274.118525:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599274.118581:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599274.118614:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522278272 00000100:00100000:2.0:1787599274.118625:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522278272 00000100:00100000:2.0:1787599274.118676:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 198 00000100:00100000:2.0:1787599274.118686:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2359:x1874433522278272:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599274.118754:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2359:x1874433522278272:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 69us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599274.118762:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 198 00000100:00100000:1.0:1787599274.118892:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522278400 00000100:00100000:1.0:1787599274.118897:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522278400 00000100:00100000:1.0:1787599274.118960:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:1.0:1787599274.118969:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522278400:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599274.119003:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522278400:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 37us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599274.119009:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00080000:2.0:1787599274.120335:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787599274.982128:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599276.002282:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599276.065441:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543280512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599276.065519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599276.065766:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543280768:0@lo:400:kworker.0 00000100:00100000:3.0:1787599276.065780:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543280640:0@lo:400:kworker.0 00000100:00100000:2.0:1787599276.065800:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599276.065837:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543280896:0@lo:400:kworker.0 00000100:00100000:3.0:1787599276.065845:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599276.065870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599276.069178:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543280512 00000100:00100000:1.0:1787599276.069193:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543280512 00000100:00100000:1.0:1787599276.069281:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599276.069291:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543280512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599276.069347:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599276.069406:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543280768 00000100:00100000:0.0:1787599276.069412:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543280768 00000100:00100000:1.0:1787599276.069445:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543280512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (3924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599276.069447:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543280896 00000100:00100000:0.0:1787599276.069452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543280896 00000100:00100000:1.0:1787599276.069457:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787599276.069481:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599276.069490:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543280768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599276.069535:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599276.069546:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543280768:12345-0@lo:400:kworker.0 Request processed in 56us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599276.069547:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543280896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599276.069559:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599276.069594:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543280896:12345-0@lo:400:kworker.0 Request processed in 50us (3723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599276.069602:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787599276.069628:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543280640 00000100:00100000:1.0:1787599276.069633:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543280640 00000100:00100000:0.0:1787599276.069664:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543280768:0@lo:400:kworker.0 00000100:00100000:1.0:1787599276.069678:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787599276.069687:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543280640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599276.069729:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543280640:12345-0@lo:400:kworker.0 Request processed in 44us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599276.069735:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:1.0:1787599276.069788:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599276.069793:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599276.069812:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543281024:0@lo:400:kworker.0 00000100:00100000:1.0:1787599276.069871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599276.071199:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543281024 00000100:00100000:0.0:1787599276.071208:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543281024 00000100:00100000:0.0:1787599276.071261:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787599276.071448:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543281024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599276.071523:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543281024:12345-0@lo:400:kworker.0 Request processed in 254us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599276.071531:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787599276.071555:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599276.074487:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543280640:0@lo:400:kworker.0 00000100:00100000:2.0:1787599276.074522:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543281152:0@lo:400:kworker.0 00000100:00100000:2.0:1787599276.074583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599276.074722:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543280896:0@lo:400:kworker.0 00000100:00100000:0.0:1787599276.074754:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543281152 00000100:00100000:0.0:1787599276.074766:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543281152 00000100:00100000:0.0:1787599276.074831:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599276.074841:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543281152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599276.074894:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543281152:12345-0@lo:400:kworker.0 Request processed in 55us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599276.074901:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1787599276.074964:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599276.074983:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543281152:0@lo:400:kworker.0 00010000:00080000:1.0:1787599276.077790:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c6f27ed80 x1874433543281024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599276.077810:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543281024:0@lo:400:kworker.0 00010000:00080000:1.0:1787599276.077826:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c760ed180 x1874433543280512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599276.077926:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543280512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787599277.026685:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787599277.276635:0:9323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00010000:00010000:1.0:1787599278.051891:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599279.073540:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599279.141490:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599279.141519:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543281280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599279.141593:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599279.141737:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543281280 00000100:00100000:1.0:1787599279.141745:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543281280 00000100:00100000:1.0:1787599279.141821:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599279.141832:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543281280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599279.141868:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599279.141931:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543281280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599279.141939:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787599279.142007:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787599279.142009:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c93b80 x1874433543281280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599279.142032:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543281280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599279.235492:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599279.235550:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599279.235656:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522278656 00000100:00100000:0.0:1787599279.235666:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522278656 00000100:00100000:0.0:1787599279.235758:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:0.0:1787599279.235769:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522278656:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599279.235847:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522278656:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 80us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599279.235855:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:2.0:1787599279.236035:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522278528 00000100:00100000:2.0:1787599279.236040:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522278528 00000100:00100000:2.0:1787599279.236081:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 200 00000100:00100000:2.0:1787599279.236089:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2356:x1874433522278528:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599279.236117:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2356:x1874433522278528:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599279.236122:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 200 00000100:00080000:1.0:1787599279.236368:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787599280.101008:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787599280.446530:0:9420:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:2.0:1787599281.121354:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599281.185667:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543281536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599281.185684:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543281792:0@lo:400:kworker.0 00000100:00100000:2.0:1787599281.185738:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543281408:0@lo:400:kworker.0 00000100:00100000:3.0:1787599281.185781:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543281664:0@lo:400:kworker.0 00000100:00100000:0.0:1787599281.191626:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599281.191716:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543282176:0@lo:400:kworker.0 00000100:00100000:0.0:1787599281.191759:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599281.191801:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543281536 00000100:00100000:0.0:1787599281.191808:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543281536 00000100:00100000:0.0:1787599281.191869:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787599281.191879:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543281536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599281.191917:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599281.191964:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543281536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599281.191971:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787599281.192008:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543282176 00000100:00100000:0.0:1787599281.192012:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543282176 00000100:00100000:0.0:1787599281.192034:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787599281.192040:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543282176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599281.192072:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543282176:12345-0@lo:400:kworker.0 Request processed in 32us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599281.192078:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787599281.192091:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787599281.192131:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c92d80 x1874433543282176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599281.192145:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543282176:0@lo:400:kworker.0 00010000:00080000:0.0:1787599281.192170:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fe22680 x1874433543281536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599281.192186:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543281536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599281.192205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599281.192227:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543281408 00000100:00100000:2.0:1787599281.192230:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543281920:0@lo:400:kworker.0 00000100:00100000:0.0:1787599281.192230:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543281408 00000100:00100000:0.0:1787599281.192266:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787599281.192273:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543281408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599281.192278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599281.193492:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543281408:12345-0@lo:400:kworker.0 Request processed in 1212us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599281.193503:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787599281.195631:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599281.195688:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543282048:0@lo:400:kworker.0 00000100:00100000:3.0:1787599281.195717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599281.195769:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543281664 00000100:00100000:3.0:1787599281.195776:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543281664 00000100:00100000:3.0:1787599281.195820:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543282048 00000100:00100000:3.0:1787599281.195823:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543282048 00000100:00100000:3.0:1787599281.195851:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599281.195867:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543281664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599281.195921:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543281664:12345-0@lo:400:kworker.0 Request processed in 56us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599281.195929:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599281.195958:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599281.195964:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543282048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599281.195991:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543282048:12345-0@lo:400:kworker.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599281.195996:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787599281.196021:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599281.196048:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543281664:0@lo:400:kworker.0 00000100:00100000:3.0:1787599281.196077:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543282048:0@lo:400:kworker.0 00000100:00100000:3.0:1787599281.196128:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543281920 00000100:00100000:3.0:1787599281.196131:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543281920 00000100:00100000:3.0:1787599281.196179:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599281.196186:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543281920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599281.196218:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543281920:12345-0@lo:400:kworker.0 Request processed in 34us (3940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599281.196224:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787599281.196497:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599281.200482:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599281.200683:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543281408:0@lo:400:kworker.0 00010000:00080000:2.0:1787599281.200703:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c90700 x1874433543281920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599281.200734:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543281920:0@lo:400:kworker.0 00000100:00100000:3.0:1787599281.200784:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543281792 00000100:00100000:3.0:1787599281.200793:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543281792 00000100:00100000:3.0:1787599281.200888:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787599281.200898:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543281792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599281.200973:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543281792:12345-0@lo:400:kworker.0 Request processed in 76us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599281.200981:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787599281.201057:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543281792:0@lo:400:kworker.0 00000100:00080000:2.0:1787599281.202977:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787599282.146207:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787599282.253801:0:9468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 15:21:19 EDT 2026 00010000:00010000:2.0:1787599283.169501:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599284.193346:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599284.261525:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599284.261558:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543282304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599284.261699:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599284.265840:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543282304 00000100:00100000:2.0:1787599284.265856:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543282304 00000100:00100000:2.0:1787599284.265952:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599284.265964:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543282304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599284.266012:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599284.266119:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543282304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (4418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599284.266128:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787599284.266192:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c6f27ed80 x1874433543282304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599284.266242:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543282304:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787599284.268887:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599284.355478:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599284.355527:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599284.355725:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522278784 00000100:00100000:3.0:1787599284.355737:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522278784 00000100:00100000:3.0:1787599284.355802:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 202 00000100:00100000:3.0:1787599284.355811:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522278784:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599284.355883:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522278784:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 73us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599284.355890:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 202 00000100:00100000:3.0:1787599284.355920:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522278912 00000100:00100000:3.0:1787599284.355933:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522278912 00000100:00100000:3.0:1787599284.355974:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:3.0:1787599284.355981:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522278912:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599284.356019:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522278912:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 40us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599284.356025:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00080000:3.0:1787599284.356183:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787599285.219519:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599286.246526:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599286.306594:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599286.306618:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543282432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599286.306704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.307700:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543282688:0@lo:400:kworker.0 00000100:00100000:2.0:1787599286.307745:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.307788:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599286.307794:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543282816:0@lo:400:kworker.0 00000100:00100000:2.0:1787599286.307818:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.307861:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543282944:0@lo:400:kworker.0 00000100:00100000:2.0:1787599286.307888:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.307904:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787599286.307909:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543282560:0@lo:400:kworker.0 00000100:00100000:2.0:1787599286.307936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.307958:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543283072:0@lo:400:kworker.0 00000100:00100000:2.0:1787599286.307978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599286.308129:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543282688 00000100:00100000:2.0:1787599286.308138:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543282688 00000100:00100000:2.0:1787599286.308206:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543282816 00000100:00100000:2.0:1787599286.308209:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543282816 00000100:00100000:2.0:1787599286.308230:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543283072 00000100:00100000:2.0:1787599286.308233:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543283072 00000100:00100000:1.0:1787599286.308370:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787599286.308382:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543282688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599286.308451:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543282688:12345-0@lo:400:kworker.0 Request processed in 72us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.308467:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787599286.308486:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787599286.308493:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543282816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599286.308525:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543282816:12345-0@lo:400:kworker.0 Request processed in 32us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.308531:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787599286.308543:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787599286.308550:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543283072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599286.308582:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543283072:12345-0@lo:400:kworker.0 Request processed in 33us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599286.308588:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787599286.308624:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543282816:0@lo:400:kworker.0 00000100:00100000:1.0:1787599286.308637:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543282688:0@lo:400:kworker.0 00000100:00100000:1.0:1787599286.308689:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543283072:0@lo:400:kworker.0 00000100:00080000:3.0:1787599286.309309:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599286.309387:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543282432 00000100:00100000:0.0:1787599286.309394:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543282432 00000100:00100000:0.0:1787599286.309447:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787599286.309455:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543282432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599286.309485:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599286.309547:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543282432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (2843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.309554:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787599286.309575:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543282944 00000100:00100000:0.0:1787599286.309579:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543282944 00000100:00100000:0.0:1787599286.309604:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787599286.309611:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543282944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599286.309642:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543282560 00000100:00100000:1.0:1787599286.309647:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543282560 00000100:00100000:0.0:1787599286.309647:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543282944:12345-0@lo:400:kworker.0 Request processed in 38us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.309653:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599286.309671:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787599286.309677:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543282560:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787599286.309680:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75e4e300 x1874433543282944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599286.309693:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543282944:0@lo:400:kworker.0 00000100:00100000:1.0:1787599286.309709:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543282560:12345-0@lo:400:kworker.0 Request processed in 32us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599286.309709:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543282560:0@lo:400:kworker.0 00000100:00100000:1.0:1787599286.309715:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:3.0:1787599286.309776:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599286.309780:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787599286.309795:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fe22680 x1874433543282432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599286.309812:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543282432:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787599287.266572:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599288.289402:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599289.314331:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599289.377825:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543283200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599289.377896:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599289.378013:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543283200 00000100:00100000:1.0:1787599289.378022:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543283200 00000100:00100000:1.0:1787599289.378086:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599289.378115:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543283200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599289.378149:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599289.378222:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543283200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599289.378229:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787599289.378271:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c91500 x1874433543283200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599289.378291:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543283200:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787599289.378358:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599289.476093:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599289.476231:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599289.476846:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522279040 00000100:00100000:0.0:1787599289.476856:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522279040 00000100:00100000:0.0:1787599289.476909:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 204 00000100:00100000:0.0:1787599289.476918:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2359:x1874433522279040:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599289.476982:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2359:x1874433522279040:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 65us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599289.476989:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 204 00000100:00100000:1.0:1787599289.477864:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522279168 00000100:00100000:1.0:1787599289.477873:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522279168 00000100:00100000:1.0:1787599289.477948:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:1.0:1787599289.477958:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522279168:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599289.478005:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522279168:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 49us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599289.478012:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00080000:1.0:1787599289.478035:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787599290.338392:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599291.364767:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599291.426827:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543283584:0@lo:400:kworker.0 00000100:00100000:0.0:1787599291.426911:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543283328:0@lo:400:kworker.0 00000100:00100000:3.0:1787599291.426912:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599291.426963:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599291.426968:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787599291.426976:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543283456:0@lo:400:kworker.0 00000100:00100000:3.0:1787599291.426999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599291.427015:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543283968:0@lo:400:kworker.0 00000100:00100000:3.0:1787599291.427034:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599291.427074:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543283584 00000100:00100000:3.0:1787599291.427082:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543283584 00000100:00100000:0.0:1787599291.427086:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543283840:0@lo:400:kworker.0 00000100:00100000:0.0:1787599291.427123:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599291.427154:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599291.427184:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543283712:0@lo:400:kworker.0 00000100:00100000:0.0:1787599291.427208:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599291.427238:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543283328 00000100:00100000:0.0:1787599291.427242:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543283328 00000100:00100000:0.0:1787599291.427270:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787599291.427279:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543283328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599291.427331:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543283328:12345-0@lo:400:kworker.0 Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599291.427337:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787599291.427437:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543283968 00000100:00100000:0.0:1787599291.427441:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543283968 00000100:00100000:0.0:1787599291.427914:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543283712 00000100:00100000:0.0:1787599291.427919:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543283712 00000100:00100000:0.0:1787599291.427937:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787599291.427944:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543283968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599291.427988:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543283968:12345-0@lo:400:kworker.0 Request processed in 44us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599291.428006:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787599291.428018:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599291.428024:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543283712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599291.428050:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543283712:12345-0@lo:400:kworker.0 Request processed in 27us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599291.428056:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787599291.428111:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75e4d180 x1874433543283712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599291.428126:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543283712:0@lo:400:kworker.0 00000100:00100000:0.0:1787599291.428148:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543283328:0@lo:400:kworker.0 00000100:00080000:0.0:1787599291.428208:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599291.428211:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599291.428214:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599291.429896:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543283456 00000100:00100000:1.0:1787599291.429897:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543283840 00000100:00100000:3.0:1787599291.429908:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543283456 00000100:00100000:1.0:1787599291.429909:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543283840 00000100:00100000:1.0:1787599291.429973:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787599291.430932:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543283584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599291.430950:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787599291.430962:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543283840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599291.431019:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543283584:12345-0@lo:400:kworker.0 Request processed in 1038us (4107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599291.431027:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787599291.431052:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787599291.431097:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543284096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599291.431148:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543283456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599291.431153:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543283840:12345-0@lo:400:kworker.0 Request processed in 192us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599291.431220:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543283456:12345-0@lo:400:kworker.0 Request processed in 161us (4219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599291.431284:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787599291.431489:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543283840:0@lo:400:kworker.0 00000100:00100000:1.0:1787599291.431610:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787599291.431643:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599291.432082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599291.432132:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543283456:0@lo:400:kworker.0 00010000:00080000:0.0:1787599291.432148:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75e4d500 x1874433543283968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599291.432274:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543283968:0@lo:400:kworker.0 00000100:00100000:0.0:1787599291.432289:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543283584:0@lo:400:kworker.0 00000100:00100000:1.0:1787599291.435238:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543284096 00000100:00100000:1.0:1787599291.435254:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543284096 00000100:00100000:1.0:1787599291.435356:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599291.435377:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543284096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599291.435417:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599291.435519:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543284096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (3437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599291.435526:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787599291.436303:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c91500 x1874433543284096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599291.436326:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543284096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787599292.386016:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599293.411132:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599294.434772:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599294.498373:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543284224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599294.498456:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599294.498628:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543284224 00000100:00100000:1.0:1787599294.498637:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543284224 00000100:00100000:1.0:1787599294.498706:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787599294.498719:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543284224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599294.498755:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599294.498807:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543284224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599294.498814:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787599294.498857:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c93100 x1874433543284224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599294.498877:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543284224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787599294.498933:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599294.607381:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599294.607540:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599294.608236:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522279424 00000100:00100000:0.0:1787599294.608247:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522279424 00000100:00100000:0.0:1787599294.608328:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:0.0:1787599294.608339:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522279424:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599294.608418:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522279424:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 80us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599294.608426:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00080000:1.0:1787599294.608956:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599294.609921:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522279296 00000100:00100000:2.0:1787599294.609932:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522279296 00000100:00100000:2.0:1787599294.609993:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 206 00000100:00100000:2.0:1787599294.610030:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522279296:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599294.610861:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522279296:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 828us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599294.610883:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 206 00010000:00010000:3.0:1787599295.457950:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599296.486326:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599296.545451:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543284736:0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.545527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599296.545600:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787599296.545607:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543284352:0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.545635:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599296.545660:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543284864:0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.545682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599296.545708:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543284480:0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.545729:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599296.545744:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543284992:0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.545761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599296.545777:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599296.545781:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543284608:0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.545798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599296.545821:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543284864 00000100:00100000:1.0:1787599296.545828:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543284864 00000100:00100000:1.0:1787599296.545872:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543284480 00000100:00100000:1.0:1787599296.545875:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543284480 00000100:00100000:1.0:1787599296.545885:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543284608 00000100:00100000:1.0:1787599296.545887:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543284608 00000100:00100000:1.0:1787599296.545901:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787599296.545908:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543284864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.545952:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543284864:12345-0@lo:400:kworker.0 Request processed in 44us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599296.545974:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787599296.545991:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599296.546005:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543284480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.546038:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543284480:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599296.546043:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599296.546055:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787599296.546061:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543284608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.546085:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543284608:12345-0@lo:400:kworker.0 Request processed in 25us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599296.546090:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787599296.546109:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599296.546140:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543284608:0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.546150:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543284480:0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.546210:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543284864:0@lo:400:kworker.0 00000100:00100000:0.0:1787599296.546216:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543284736 00000100:00100000:0.0:1787599296.546225:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543284736 00000100:00080000:1.0:1787599296.546497:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599296.546765:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599296.546776:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543285120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599296.546810:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599296.546842:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543285120 00000100:00100000:3.0:1787599296.546846:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543285120 00000100:00100000:3.0:1787599296.546879:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787599296.546886:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543285120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599296.546917:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599296.546953:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543285120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599296.546972:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787599296.546993:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787599296.547010:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75e4ed80 x1874433543285120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599296.547026:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543285120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599296.547069:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543284992 00000100:00100000:0.0:1787599296.547073:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543284992 00000100:00100000:1.0:1787599296.547484:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599296.547497:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543284736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.547562:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543284736:12345-0@lo:400:kworker.0 Request processed in 70us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599296.547569:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599296.547584:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787599296.547591:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543284992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.547623:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543284992:12345-0@lo:400:kworker.0 Request processed in 33us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599296.547628:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787599296.547660:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543284352 00000100:00100000:1.0:1787599296.547664:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543284352 00010000:00080000:3.0:1787599296.547682:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c92a00 x1874433543284736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599296.547688:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787599296.547694:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543284736:0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.547694:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543284352:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787599296.547719:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c90a80 x1874433543284992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599296.547728:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543284352:12345-0@lo:400:kworker.0 Request processed in 34us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599296.547734:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543284992:0@lo:400:kworker.0 00000100:00100000:1.0:1787599296.547734:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787599296.547757:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543284352:0@lo:400:kworker.0 00010000:00010000:3.0:1787599297.505740:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599298.531791:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787599299.441875:0:10099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:21:36 (1787599296) === 00010000:00010000:3.0:1787599299.554335:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599299.627076:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599299.627108:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543285248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599299.627259:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599299.627348:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543285248 00000100:00100000:2.0:1787599299.627358:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543285248 00000100:00100000:2.0:1787599299.627432:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787599299.627443:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543285248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599299.627492:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599299.627547:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543285248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599299.627556:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787599299.627582:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787599299.627619:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fa0ea00 x1874433543285248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599299.627645:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543285248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599299.718355:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599299.718399:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599299.718504:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522279680 00000100:00100000:1.0:1787599299.718523:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522279680 00000100:00100000:1.0:1787599299.718646:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:1.0:1787599299.718663:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522279680:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599299.718807:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522279680:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 149us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599299.718815:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00080000:2.0:1787599299.718922:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599299.719214:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522279552 00000100:00100000:0.0:1787599299.719220:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522279552 00000100:00100000:0.0:1787599299.719264:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 208 00000100:00100000:0.0:1787599299.719272:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522279552:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599299.719323:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522279552:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 53us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599299.719330:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 208 00000100:00100000:3.0:1787599299.910438:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599299.910645:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522279808 00000100:00100000:2.0:1787599299.910656:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522279808 00000100:00100000:2.0:1787599299.910716:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 209 00000100:00100000:2.0:1787599299.910725:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:8131:x1874433522279808:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599299.910741:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599299.910769:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75618c00/0xa46cbc6741182646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e070f6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599299.910797:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75618c00/0xa46cbc6741182646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070f6 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599299.910808:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75618c00/0xa46cbc6741182646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070f6 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599299.910818:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618c00, rc 0) 00000100:00100000:2.0:1787599299.910873:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:8131:x1874433522279808:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 149us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599299.910880:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 209 00000100:00100000:2.0:1787599299.924694:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599299.924818:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522279936 00000100:00100000:1.0:1787599299.924837:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522279936 00000100:00100000:1.0:1787599299.924944:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 210 00000100:00100000:1.0:1787599299.924957:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:8131:x1874433522279936:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787599299.925409:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:8131:x1874433522279936:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 452us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599299.925419:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 210 00000100:00100000:3.0:1787599299.928534:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599299.929721:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522280064 00000100:00100000:0.0:1787599299.929735:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522280064 00000100:00100000:0.0:1787599299.929805:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 211 00000100:00100000:0.0:1787599299.929817:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:8131:x1874433522280064:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787599299.930077:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:8131:x1874433522280064:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 261us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599299.930085:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 211 00000100:00100000:3.0:1787599299.942843:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599299.943059:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522280192 00000100:00100000:2.0:1787599299.943070:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522280192 00000100:00100000:2.0:1787599299.943134:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 212 00000100:00100000:2.0:1787599299.943146:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:8135:x1874433522280192:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599299.943469:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:8135:x1874433522280192:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 324us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599299.943477:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 212 00000100:00100000:2.0:1787599299.964751:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599299.964948:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522280320 00000100:00100000:1.0:1787599299.964959:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522280320 00000100:00100000:1.0:1787599299.965015:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 213 00000100:00100000:1.0:1787599299.965024:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:8135:x1874433522280320:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599299.965547:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:8135:x1874433522280320:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 416us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599299.965557:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 213 00000100:00100000:3.0:1787599299.976980:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599299.977194:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522280448 00000100:00100000:2.0:1787599299.977209:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522280448 00000100:00100000:2.0:1787599299.977280:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 214 00000100:00100000:2.0:1787599299.977292:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:8131:x1874433522280448:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599299.977317:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599299.977358:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75619800/0xa46cbc674118264d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07120 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599299.977398:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75619800/0xa46cbc674118264d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07120 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599299.977411:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75619800/0xa46cbc674118264d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07120 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599299.977423:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619800, rc 0) 00000100:00100000:2.0:1787599299.977507:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:8131:x1874433522280448:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 217us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599299.977516:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 214 00000100:00100000:2.0:1787599299.982693:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599299.984402:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522280576 00000100:00100000:1.0:1787599299.984420:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522280576 00000100:00100000:1.0:1787599299.984526:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 215 00000100:00100000:1.0:1787599299.984539:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:8131:x1874433522280576:12345-192.168.204.30@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787599299.984580:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787599299.984619:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787599299.984624:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787599299.984628:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787599299.984630:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787599299.986333:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:8131:x1874433522280576:12345-192.168.204.30@tcp:256:mount.lustre.0 Request processed in 1781us (3648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599299.986353:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 215 00000100:00100000:3.0:1787599299.989477:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599299.990939:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522280704 00000100:00100000:2.0:1787599299.990957:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522280704 00000100:00100000:2.0:1787599299.991026:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 216 00000100:00100000:2.0:1787599299.991038:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:8131:x1874433522280704:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599299.991062:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599299.991085:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75619c00/0xa46cbc6741182654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07127 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599299.991123:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75619c00/0xa46cbc6741182654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07127 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599299.991136:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75619c00/0xa46cbc6741182654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07127 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599299.991146:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619c00, rc 0) 00000100:00100000:2.0:1787599299.991500:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:8131:x1874433522280704:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 462us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599299.991507:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 216 00000100:00100000:3.0:1787599299.994626:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599299.994936:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522280832 00000100:00100000:1.0:1787599299.994958:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522280832 00000100:00100000:0.0:1787599299.995370:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 217 00000100:00100000:0.0:1787599299.995389:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:8131:x1874433522280832:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787599299.996092:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:8131:x1874433522280832:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 703us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599299.996104:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 217 00000100:00100000:3.0:1787599299.998817:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599299.998972:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522280960 00000100:00100000:0.0:1787599299.999002:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522280960 00000100:00100000:0.0:1787599299.999118:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 218 00000100:00100000:0.0:1787599299.999132:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:8131:x1874433522280960:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787599299.999511:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:8131:x1874433522280960:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 381us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599299.999521:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 218 00000100:00100000:3.0:1787599300.003129:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599300.004086:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522281088 00000100:00100000:1.0:1787599300.004103:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522281088 00000100:00100000:1.0:1787599300.004203:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 219 00000100:00100000:1.0:1787599300.004215:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:8139:x1874433522281088:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599300.004533:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:8139:x1874433522281088:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 319us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.004542:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 219 00000100:00100000:3.0:1787599300.012439:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599300.013475:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522281216 00000100:00100000:1.0:1787599300.013493:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522281216 00000100:00100000:1.0:1787599300.013575:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 220 00000100:00100000:1.0:1787599300.013588:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:8139:x1874433522281216:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599300.013963:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:8139:x1874433522281216:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 376us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.013980:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 220 00000100:00100000:3.0:1787599300.023598:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599300.024280:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522281344 00000100:00100000:1.0:1787599300.024297:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522281344 00000100:00100000:1.0:1787599300.024361:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1787599300.024374:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1874433522281344:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787599300.024414:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9d1eea31-9ea5-425c-a3e4-31fb355e375a@192.168.204.30@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1787599300.024462:0:5833:0:(genops.c:1385:class_connect()) connect: client 9d1eea31-9ea5-425c-a3e4-31fb355e375a, cookie 0xa46cbc674118265b 00000004:00100000:1.0:1787599300.024866:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787599300.026263:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9f6c81f33800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599300.027682:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2355:x1874433522281344:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 3284us (4074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.027700:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1787599300.033659:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599300.034588:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522281472 00000100:00100000:1.0:1787599300.034607:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522281472 00000100:00100000:1.0:1787599300.035048:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:1.0:1787599300.035064:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:0:x1874433522281472:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787599300.035136:0:8189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787599300.036439:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599300.036557:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:0:x1874433522281472:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 1429us (3644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.036570:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:1.0:1787599300.036613:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522281600 00000100:00100000:1.0:1787599300.036622:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522281600 00000100:00100000:1.0:1787599300.036911:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1787599300.036923:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:8131:x1874433522281600:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787599300.036958:0:8189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787599300.037018:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:8131:x1874433522281600:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 97us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.037026:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00080000:3.0:1787599300.037467:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599300.044574:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599300.044649:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522281728 00000100:00100000:0.0:1787599300.044664:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522281728 00000100:00100000:0.0:1787599300.044754:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:0.0:1787599300.044768:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:8131:x1874433522281728:12345-192.168.204.30@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787599300.044887:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:8131:x1874433522281728:12345-192.168.204.30@tcp:40:mount.lustre.0 Request processed in 121us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599300.044906:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1787599300.048630:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599300.049085:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599300.049123:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599300.049287:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522281856 00000100:00100000:1.0:1787599300.049302:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522281856 00000100:00100000:1.0:1787599300.049356:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522281984 00000100:00100000:1.0:1787599300.049359:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522281984 00000100:00100000:1.0:1787599300.049379:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1787599300.049389:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874433522281856:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787599300.049435:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9d1eea31-9ea5-425c-a3e4-31fb355e375a@192.168.204.30@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1787599300.049482:0:6678:0:(genops.c:1385:class_connect()) connect: client 9d1eea31-9ea5-425c-a3e4-31fb355e375a, cookie 0xa46cbc6741182662 00000100:00100000:2.0:1787599300.049576:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522282112 00000100:00100000:2.0:1787599300.049582:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522282112 00000100:00100000:2.0:1787599300.049627:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1787599300.049651:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:8131:x1874433522282112:12345-192.168.204.30@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787599300.050373:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787599300.050555:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:8131:x1874433522282112:12345-192.168.204.30@tcp:33:mount.lustre.0 Request processed in 918us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599300.050564:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00002000:00100000:1.0:1787599300.050749:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9d1eea31-9ea5-425c-a3e4-31fb355e375a/ffff9f6c81f30000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599300.050766:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599300.050997:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787599300.051040:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9f6c81f36000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599300.051081:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2355:x1874433522281856:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 1693us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.051090:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1787599300.051117:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1787599300.051124:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874433522281984:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787599300.051149:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9d1eea31-9ea5-425c-a3e4-31fb355e375a@192.168.204.30@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1787599300.051215:0:6678:0:(genops.c:1385:class_connect()) connect: client 9d1eea31-9ea5-425c-a3e4-31fb355e375a, cookie 0xa46cbc6741182669 00002000:00100000:1.0:1787599300.051222:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9d1eea31-9ea5-425c-a3e4-31fb355e375a/ffff9f6c81f31800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599300.051242:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599300.051409:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787599300.051427:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9f6c81f37000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599300.051454:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2355:x1874433522281984:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 328us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599300.051461:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00010000:00010000:1.0:1787599300.578333:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599301.604510:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599301.665318:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599301.665351:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543285376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599301.665456:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599301.665596:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543285376 00000100:00100000:2.0:1787599301.665607:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543285376 00000100:00100000:2.0:1787599301.665690:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599301.665702:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543285376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599301.665751:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599301.665814:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543285376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599301.665823:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787599301.665927:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75e4f800 x1874433543285376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599301.665953:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543285376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599301.669696:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543285632:0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.669815:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599301.669883:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787599301.669890:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543285504:0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.669925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599301.669953:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543286016:0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.669972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599301.670008:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543285888:0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.670036:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599301.670052:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599301.670056:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543285760:0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.670074:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599301.670102:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543285632 00000100:00100000:2.0:1787599301.670112:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543285632 00000100:00100000:2.0:1787599301.670183:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543286016 00000100:00100000:2.0:1787599301.670186:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543286016 00000100:00100000:2.0:1787599301.670203:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543285760 00000100:00100000:2.0:1787599301.670205:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543285760 00000100:00100000:2.0:1787599301.670222:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787599301.670231:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543285632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.670289:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543285632:12345-0@lo:400:kworker.0 Request processed in 58us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599301.670297:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787599301.670316:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787599301.670323:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543286016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.670353:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543286016:12345-0@lo:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599301.670359:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787599301.670382:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787599301.670388:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543285760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.670423:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543285760:12345-0@lo:400:kworker.0 Request processed in 35us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599301.670429:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787599301.670451:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543285504 00000100:00100000:2.0:1787599301.670454:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543285504 00000100:00100000:2.0:1787599301.670487:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787599301.670493:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543285504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.670524:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543285504:12345-0@lo:400:kworker.0 Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599301.670530:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787599301.670598:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543285760:0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.670635:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543285504:0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.670646:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543286016:0@lo:400:kworker.0 00000100:00100000:2.0:1787599301.670656:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543285632:0@lo:400:kworker.0 00000100:00080000:3.0:1787599301.670789:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599301.670804:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599301.670824:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543285888 00000100:00100000:3.0:1787599301.670828:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543285888 00000100:00100000:3.0:1787599301.670892:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787599301.670903:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543285888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599301.670947:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543285888:12345-0@lo:400:kworker.0 Request processed in 49us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599301.670953:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787599301.670985:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75026300 x1874433543285888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599301.670997:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543285888:0@lo:400:kworker.0 00000100:00080000:2.0:1787599301.671491:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787599302.275087:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9d1eea31-9ea5-425c-a3e4-31fb355e375a 00010000:00010000:1.0:1787599302.628264:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599303.651319:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787599303.780105:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9d1eea31-9ea5-425c-a3e4-31fb355e375a 00000001:00100000:0.0:1787599303.812319:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9d1eea31-9ea5-425c-a3e4-31fb355e375a 00010000:00010000:1.0:1787599304.673393:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599304.737507:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599304.737536:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543286144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599304.737642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599304.737853:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543286144 00000100:00100000:2.0:1787599304.737862:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543286144 00000100:00100000:2.0:1787599304.737946:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599304.737958:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543286144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599304.738000:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599304.738059:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543286144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599304.738094:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787599304.738215:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787599304.739101:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75025c00 x1874433543286144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599304.739130:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543286144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599305.352968:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599305.353014:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599305.353041:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599305.353059:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599305.353084:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599305.353117:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522282496 00000100:00100000:2.0:1787599305.353128:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522282496 00000100:00100000:2.0:1787599305.353205:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522282368 00000100:00100000:2.0:1787599305.353209:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522282368 00000100:00100000:2.0:1787599305.353232:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:2.0:1787599305.353241:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522282496:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599305.353314:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522282496:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599305.353322:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:2.0:1787599305.353338:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:2.0:1787599305.353345:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522282368:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599305.353368:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522282368:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599305.353374:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:2.0:1787599305.353407:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522282752 00000100:00100000:2.0:1787599305.353411:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522282752 00000100:00100000:2.0:1787599305.353435:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522282624 00000100:00100000:2.0:1787599305.353437:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522282624 00000100:00100000:2.0:1787599305.353451:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1787599305.353457:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522282752:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599305.353499:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522282752:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 42us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599305.353506:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1787599305.353517:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:2.0:1787599305.353523:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522282624:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599305.353545:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522282624:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599305.353552:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00080000:2.0:1787599305.353574:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599305.353578:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599305.353580:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599305.353647:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522282240 00000100:00100000:0.0:1787599305.353652:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522282240 00000100:00100000:0.0:1787599305.353688:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 222 00000100:00100000:0.0:1787599305.353695:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522282240:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599305.353722:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522282240:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599305.353728:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 222 00010000:00010000:2.0:1787599305.698695:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787599305.922583:0:10296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787599306.722338:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599306.787357:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543286272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599306.787480:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599306.787566:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543286272 00000100:00100000:3.0:1787599306.787574:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543286272 00000100:00100000:3.0:1787599306.787648:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599306.787659:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543286272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599306.787697:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599306.787739:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543286272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599306.787746:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787599306.787792:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787599306.787903:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75e4f800 x1874433543286272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599306.787923:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543286272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599306.795482:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543286528:0@lo:400:kworker.0 00000100:00100000:0.0:1787599306.795579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599306.795656:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543286528 00000100:00100000:0.0:1787599306.795666:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543286528 00000100:00100000:0.0:1787599306.795734:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787599306.795745:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543286528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599306.795817:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543286528:12345-0@lo:400:kworker.0 Request processed in 73us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599306.795825:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787599306.795891:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543286528:0@lo:400:kworker.0 00000100:00100000:0.0:1787599306.795930:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543286656:0@lo:400:kworker.0 00000100:00100000:0.0:1787599306.795969:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599306.796010:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543286656 00000100:00100000:0.0:1787599306.796014:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543286656 00000100:00100000:0.0:1787599306.796045:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787599306.796053:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543286656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599306.796110:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543286656:12345-0@lo:400:kworker.0 Request processed in 58us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599306.796117:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787599306.796147:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543286656:0@lo:400:kworker.0 00000100:00100000:1.0:1787599306.796533:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543286400:0@lo:400:kworker.0 00000100:00100000:1.0:1787599306.796582:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599306.796621:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543286912:0@lo:400:kworker.0 00000100:00100000:1.0:1787599306.796644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599306.796660:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599306.796665:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543286784:0@lo:400:kworker.0 00000100:00100000:1.0:1787599306.796687:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599306.796715:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543286784 00000100:00100000:1.0:1787599306.796719:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543286784 00000100:00100000:1.0:1787599306.796755:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787599306.796776:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543286784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599306.796813:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543286784:12345-0@lo:400:kworker.0 Request processed in 51us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599306.796831:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787599306.796877:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c483b0700 x1874433543286784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599306.796888:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543286784:0@lo:400:kworker.0 00000100:00080000:3.0:1787599306.797674:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599306.797682:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599306.797794:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543286400 00000100:00100000:0.0:1787599306.797800:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543286400 00000100:00100000:0.0:1787599306.797844:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787599306.797853:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543286400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599306.797913:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543286400:12345-0@lo:400:kworker.0 Request processed in 62us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599306.797920:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787599306.797950:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543286912 00000100:00100000:0.0:1787599306.797954:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543286912 00000100:00100000:0.0:1787599306.797984:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787599306.797997:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543286912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599306.798027:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543286912:12345-0@lo:400:kworker.0 Request processed in 30us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599306.798033:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787599306.798108:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543286400:0@lo:400:kworker.0 00000100:00100000:3.0:1787599306.798120:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543286912:0@lo:400:kworker.0 00000100:00080000:3.0:1787599306.798137:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787599307.749179:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599308.775825:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599309.793469:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599309.861744:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543287040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599309.861816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599309.862993:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543287040 00000100:00100000:2.0:1787599309.863004:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543287040 00000100:00100000:2.0:1787599309.863066:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599309.863077:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543287040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599309.863126:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599309.863205:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543287040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599309.863213:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787599309.863233:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787599309.863274:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75025500 x1874433543287040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599309.863298:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543287040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599310.465677:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599310.465726:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599310.465761:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599310.465794:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599310.465820:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599310.465852:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522283392 00000100:00100000:3.0:1787599310.465861:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522283392 00000100:00100000:3.0:1787599310.465919:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522283264 00000100:00100000:3.0:1787599310.465922:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522283264 00000100:00100000:3.0:1787599310.465942:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:3.0:1787599310.465953:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522283392:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599310.466029:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522283392:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599310.466036:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:3.0:1787599310.466068:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:3.0:1787599310.466075:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522283264:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599310.466103:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522283264:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599310.466109:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00080000:3.0:1787599310.466126:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599310.466130:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599310.466420:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522283136 00000100:00100000:0.0:1787599310.466425:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522283136 00000100:00100000:0.0:1787599310.466470:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522283008 00000100:00100000:0.0:1787599310.466474:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522283008 00000100:00100000:0.0:1787599310.466495:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:0.0:1787599310.466501:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522283136:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599310.466534:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522283136:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 33us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599310.466540:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:0.0:1787599310.466556:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:0.0:1787599310.466563:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522283008:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599310.466587:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522283008:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599310.466593:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00080000:1.0:1787599310.466664:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599310.468016:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522282880 00000100:00100000:2.0:1787599310.468042:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522282880 00000100:00100000:2.0:1787599310.468093:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 224 00000100:00100000:2.0:1787599310.468101:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522282880:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599310.468187:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522282880:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 55us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599310.468196:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 224 00010000:00010000:1.0:1787599310.817985:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599311.842586:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599311.905949:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543287168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599311.906023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599311.906109:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543287168 00000100:00100000:0.0:1787599311.906117:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543287168 00000100:00100000:0.0:1787599311.906191:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787599311.906200:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543287168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599311.906233:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599311.906285:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543287168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599311.906292:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787599311.906332:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b1fb80 x1874433543287168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599311.906351:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543287168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599311.906525:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543287424:0@lo:400:kworker.0 00000100:00100000:3.0:1787599311.906555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599311.906576:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787599311.906582:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543287296:0@lo:400:kworker.0 00000100:00100000:3.0:1787599311.906604:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599311.906622:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543287808:0@lo:400:kworker.0 00000100:00100000:3.0:1787599311.906651:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599311.906686:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543287424 00000100:00100000:3.0:1787599311.906690:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543287424 00000100:00100000:3.0:1787599311.906717:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543287808 00000100:00100000:3.0:1787599311.906719:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543287808 00000100:00100000:3.0:1787599311.906738:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787599311.906744:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543287424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599311.906778:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543287424:12345-0@lo:400:kworker.0 Request processed in 34us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599311.906784:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787599311.906800:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787599311.906806:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543287808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599311.906831:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543287808:12345-0@lo:400:kworker.0 Request processed in 26us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599311.906843:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787599311.906880:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543287808:0@lo:400:kworker.0 00000100:00100000:3.0:1787599311.906889:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543287424:0@lo:400:kworker.0 00000100:00100000:1.0:1787599311.907028:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543287552:0@lo:400:kworker.0 00000100:00100000:1.0:1787599311.907066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599311.907087:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599311.907092:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543287680:0@lo:400:kworker.0 00000100:00100000:1.0:1787599311.907112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787599311.907133:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599311.907137:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599311.907145:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543287296 00000100:00100000:1.0:1787599311.907148:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543287296 00000100:00100000:1.0:1787599311.907194:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787599311.907201:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543287296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599311.907234:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543287296:12345-0@lo:400:kworker.0 Request processed in 34us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599311.907240:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787599311.907263:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543287680 00000100:00100000:1.0:1787599311.907266:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543287680 00000100:00100000:1.0:1787599311.907292:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787599311.907298:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543287680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599311.907339:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543287680:12345-0@lo:400:kworker.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599311.907345:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787599311.907363:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787599311.907378:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b1f800 x1874433543287680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599311.907387:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543287680:0@lo:400:kworker.0 00000100:00100000:1.0:1787599311.907400:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543287552 00000100:00100000:1.0:1787599311.907403:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543287552 00000100:00100000:1.0:1787599311.907424:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787599311.907430:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543287552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599311.907456:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543287552:12345-0@lo:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599311.907462:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1787599311.907474:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599311.907487:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543287552:0@lo:400:kworker.0 00000100:00100000:1.0:1787599311.907502:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543287296:0@lo:400:kworker.0 00010000:00010000:1.0:1787599312.877342:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599313.889341:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599314.914906:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599314.982789:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599314.982814:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543287936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599314.982895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599314.982974:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543287936 00000100:00100000:0.0:1787599314.982982:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543287936 00000100:00100000:0.0:1787599314.983048:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787599314.983059:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543287936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599314.983102:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599314.983150:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543287936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599314.983175:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787599314.983241:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c93b80 x1874433543287936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599314.983264:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543287936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787599314.983319:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599315.590662:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599315.590758:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599315.590797:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599315.590829:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599315.590895:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522283520 00000100:00100000:2.0:1787599315.590905:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522283520 00000100:00100000:2.0:1787599315.590956:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 226 00000100:00100000:2.0:1787599315.590966:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522283520:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599315.591052:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522283520:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 87us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599315.591060:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 226 00000100:00100000:1.0:1787599315.591153:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522283904 00000100:00100000:1.0:1787599315.591666:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522283904 00000100:00100000:1.0:1787599315.591725:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:1.0:1787599315.591735:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522283904:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599315.591776:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522283904:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 42us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599315.591798:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00080000:2.0:1787599315.591951:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599315.595249:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599315.595816:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522283648 00000100:00100000:3.0:1787599315.595828:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522283648 00000100:00100000:3.0:1787599315.596083:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522283776 00000100:00100000:3.0:1787599315.596087:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522283776 00000100:00080000:0.0:1787599315.596464:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599315.596666:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:3.0:1787599315.596764:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522283648:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599315.597024:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522283648:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 347us (6373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599315.597033:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:3.0:1787599315.597053:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:3.0:1787599315.597061:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522283776:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599315.597088:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522283776:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (6258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599315.597093:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:1.0:1787599315.597754:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522284032 00000100:00100000:1.0:1787599315.597763:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522284032 00000100:00100000:1.0:1787599315.597821:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:1.0:1787599315.597839:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522284032:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599315.597882:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522284032:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 53us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599315.597888:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00080000:0.0:1787599315.598078:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787599315.937348:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599316.963099:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599317.027042:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543288448:0@lo:400:kworker.0 00000100:00100000:2.0:1787599317.027149:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599317.027387:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787599317.027395:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543288320:0@lo:400:kworker.0 00000100:00100000:2.0:1787599317.027425:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599317.027446:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543288832:0@lo:400:kworker.0 00000100:00100000:2.0:1787599317.027503:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599317.027554:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543288448 00000100:00100000:2.0:1787599317.027563:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543288448 00000100:00100000:2.0:1787599317.027639:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543288320 00000100:00100000:2.0:1787599317.027642:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543288320 00000100:00100000:2.0:1787599317.027664:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787599317.027674:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543288448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599317.027744:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543288448:12345-0@lo:400:kworker.0 Request processed in 71us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599317.027752:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787599317.027769:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787599317.027775:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543288320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599317.027797:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543288320:12345-0@lo:400:kworker.0 Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599317.027803:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787599317.027822:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599317.027861:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543288320:0@lo:400:kworker.0 00000100:00100000:2.0:1787599317.027871:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543288448:0@lo:400:kworker.0 00000100:00100000:0.0:1787599317.027974:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543288192:0@lo:400:kworker.0 00000100:00100000:0.0:1787599317.028018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599317.028056:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543288704:0@lo:400:kworker.0 00000100:00100000:0.0:1787599317.028078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599317.028093:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787599317.028098:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543288064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599317.028120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599317.028137:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543288576:0@lo:400:kworker.0 00000100:00100000:0.0:1787599317.028318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599317.028351:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543288064 00000100:00100000:0.0:1787599317.028356:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543288064 00000100:00100000:0.0:1787599317.028400:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599317.028408:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543288064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599317.028446:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599317.028486:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543288064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599317.028492:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787599317.028529:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b1c380 x1874433543288064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599317.028547:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543288064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599317.029083:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543288832 00000100:00100000:1.0:1787599317.029093:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543288832 00000100:00100000:1.0:1787599317.029144:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543288576 00000100:00100000:1.0:1787599317.029148:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543288576 00000100:00100000:1.0:1787599317.029225:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599317.029235:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543288832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599317.029302:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543288832:12345-0@lo:400:kworker.0 Request processed in 69us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599317.029309:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599317.029325:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787599317.029332:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c764dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543288576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599317.029370:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c764dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543288576:12345-0@lo:400:kworker.0 Request processed in 39us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599317.029376:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787599317.029622:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75026680 x1874433543288576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599317.029636:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543288576:0@lo:400:kworker.0 00000100:00100000:2.0:1787599317.029924:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543288192 00000100:00100000:2.0:1787599317.029930:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543288192 00010000:00080000:0.0:1787599317.030049:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75025c00 x1874433543288832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599317.030062:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543288832:0@lo:400:kworker.0 00000100:00100000:2.0:1787599317.030143:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787599317.030153:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543288192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599317.030272:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543288192:12345-0@lo:400:kworker.0 Request processed in 120us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599317.030279:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787599317.030395:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543288192:0@lo:400:kworker.0 00000100:00080000:1.0:1787599317.030430:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599317.030436:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599317.030450:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543288704 00000100:00100000:1.0:1787599317.030454:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543288704 00000100:00100000:1.0:1787599317.030503:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787599317.030510:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543288704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599317.030554:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543288704:12345-0@lo:400:kworker.0 Request processed in 45us (2475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599317.030561:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787599317.030604:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543288704:0@lo:400:kworker.0 00000100:00080000:0.0:1787599317.030773:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787599317.991425:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599319.011668:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599320.033517:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599320.097873:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599320.097906:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543288960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599320.097976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599320.098273:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543288960 00000100:00100000:1.0:1787599320.098281:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543288960 00000100:00100000:1.0:1787599320.098356:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787599320.098366:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543288960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599320.098401:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787599320.098427:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599320.098449:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543288960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599320.098456:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787599320.098470:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c90000 x1874433543288960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599320.098491:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543288960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599320.718450:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599320.718543:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522284160 00000100:00100000:0.0:1787599320.718547:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599320.718555:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522284160 00000100:00100000:0.0:1787599320.718582:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599320.718608:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599320.718621:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 228 00000100:00100000:0.0:1787599320.718634:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599320.718646:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522284160:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599320.718661:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522284288 00000100:00100000:0.0:1787599320.718667:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522284288 00000100:00100000:0.0:1787599320.718710:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522284416 00000100:00100000:0.0:1787599320.718714:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522284416 00000100:00100000:2.0:1787599320.718729:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522284160:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599320.718739:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 228 00000100:00100000:0.0:1787599320.718743:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:0.0:1787599320.718753:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522284288:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599320.718795:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522284288:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 43us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599320.718802:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:0.0:1787599320.718821:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:0.0:1787599320.718830:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522284416:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599320.718859:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522284416:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 31us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599320.718879:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00080000:0.0:1787599320.718906:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599320.718952:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522284544 00000100:00100000:1.0:1787599320.718957:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522284544 00000100:00100000:1.0:1787599320.719006:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522284672 00000100:00100000:1.0:1787599320.719010:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522284672 00000100:00100000:1.0:1787599320.719027:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:1.0:1787599320.719034:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2355:x1874433522284544:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:1.0:1787599320.719062:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182662 00000100:00080000:1.0:1787599320.719071:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9f6c81f36000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787599320.719112:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787599320.719486:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+2:2355:x1874433522284544:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 450us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599320.719503:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:1.0:1787599320.719520:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:1.0:1787599320.719529:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2355:x1874433522284672:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:1.0:1787599320.719542:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182669 00000100:00080000:1.0:1787599320.719548:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9f6c81f37000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787599320.719579:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787599320.719662:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599320.719778:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+2:2355:x1874433522284672:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 250us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599320.719785:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00010000:00010000:1.0:1787599320.719802:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599320.719936:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599320.719940:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787599321.058330:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599322.081505:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599322.145851:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543289216:0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.145945:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599322.145998:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543289728:0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599322.146057:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787599322.146063:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543289088:0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599322.146114:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543289600:0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599322.146203:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543289344:0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146231:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599322.146264:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599322.146270:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543289472:0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146292:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599322.146325:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543289216 00000100:00100000:0.0:1787599322.146332:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543289216 00000100:00100000:0.0:1787599322.146373:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543289600 00000100:00100000:0.0:1787599322.146376:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543289600 00000100:00100000:0.0:1787599322.146397:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543289344 00000100:00100000:0.0:1787599322.146400:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543289344 00000100:00100000:0.0:1787599322.146416:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787599322.146424:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543289216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146487:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543289216:12345-0@lo:400:kworker.0 Request processed in 63us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599322.146494:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787599322.146510:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599322.146515:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543289600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146554:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543289600:12345-0@lo:400:kworker.0 Request processed in 38us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599322.146561:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599322.146573:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787599322.146579:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543289344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146607:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543289344:12345-0@lo:400:kworker.0 Request processed in 29us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599322.146614:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787599322.146632:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543289728 00000100:00100000:0.0:1787599322.146635:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543289728 00000100:00100000:0.0:1787599322.146659:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543289472 00000100:00100000:0.0:1787599322.146662:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543289472 00000100:00100000:0.0:1787599322.146677:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599322.146682:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543289728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146713:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543289728:12345-0@lo:400:kworker.0 Request processed in 31us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599322.146719:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599322.146729:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787599322.146735:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543289472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146761:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543289472:12345-0@lo:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599322.146766:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787599322.146783:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543289088 00000100:00100000:0.0:1787599322.146787:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543289088 00000100:00100000:0.0:1787599322.146809:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787599322.146814:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543289088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.146850:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543289088:12345-0@lo:400:kworker.0 Request processed in 36us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599322.146856:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:0.0:1787599322.146918:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599322.146922:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599322.146924:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599322.146935:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599322.146944:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543289856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599322.146984:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599322.147014:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543289856 00000100:00100000:0.0:1787599322.147017:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543289856 00000100:00100000:0.0:1787599322.147047:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787599322.147054:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543289856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599322.147114:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599322.147151:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543289856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599322.147178:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787599322.147213:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c74f84700 x1874433543289856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599322.147231:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543289856:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787599322.147261:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c483b1500 x1874433543289472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599322.147270:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543289472:0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.147281:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543289344:0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.147301:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543289088:0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.147322:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543289600:0@lo:400:kworker.0 00000100:00100000:0.0:1787599322.147331:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543289216:0@lo:400:kworker.0 00010000:00080000:0.0:1787599322.147339:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c483b1880 x1874433543289728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599322.147347:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543289728:0@lo:400:kworker.0 00000001:00100000:0.0:1787599322.711815:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9d1eea31-9ea5-425c-a3e4-31fb355e375a 00000020:00000080:0.0:1787599322.711825:0:6704:0:(genops.c:885:class_export_put()) final put ffff9f6c81f30000/9d1eea31-9ea5-425c-a3e4-31fb355e375a 00000020:00000080:3.0:1787599322.711967:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c81f30000/9d1eea31-9ea5-425c-a3e4-31fb355e375a for lustre-OST0000 00000020:00000080:3.0:1787599322.712038:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c81f36000 for lustre-OST0000 00010000:00010000:2.0:1787599323.106276:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599324.130054:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787599324.256786:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9d1eea31-9ea5-425c-a3e4-31fb355e375a 00000020:00000080:0.0:1787599324.256798:0:7625:0:(genops.c:885:class_export_put()) final put ffff9f6c81f31800/9d1eea31-9ea5-425c-a3e4-31fb355e375a 00000020:00000080:3.0:1787599324.256879:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c81f31800/9d1eea31-9ea5-425c-a3e4-31fb355e375a for lustre-OST0001 00000020:00000080:3.0:1787599324.256932:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c81f37000 for lustre-OST0001 00010000:00010000:0.0:1787599325.153443:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599325.217471:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599325.217498:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543289984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599325.217578:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599325.217700:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543289984 00000100:00100000:1.0:1787599325.217711:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543289984 00000100:00100000:1.0:1787599325.217790:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599325.217803:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543289984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599325.217840:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599325.217894:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543289984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599325.217902:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787599325.218076:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787599325.218111:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c91500 x1874433543289984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599325.218133:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543289984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599325.828015:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599325.828060:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599325.828095:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599325.828211:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522285056 00000100:00100000:0.0:1787599325.828223:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522285056 00000100:00100000:0.0:1787599325.828287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522284928 00000100:00100000:0.0:1787599325.828290:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522284928 00000100:00100000:0.0:1787599325.828315:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:0.0:1787599325.828325:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2359:x1874433522285056:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599325.828413:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2359:x1874433522285056:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 89us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599325.828421:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:0.0:1787599325.828440:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:0.0:1787599325.828446:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522284928:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599325.828469:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522284928:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599325.828504:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:3.0:1787599325.828952:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522284800 00000100:00100000:3.0:1787599325.828958:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522284800 00000100:00100000:3.0:1787599325.828995:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 230 00000100:00100000:3.0:1787599325.829002:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2359:x1874433522284800:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599325.829033:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2359:x1874433522284800:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 32us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599325.829039:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 230 00000100:00080000:2.0:1787599325.829106:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787599326.177406:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787599327.148933:0:11000:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787599327.203501:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599327.267549:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599327.267576:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543290112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599327.267663:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599327.267735:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543290112 00000100:00100000:0.0:1787599327.267742:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543290112 00000100:00100000:0.0:1787599327.267798:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599327.267808:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543290112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599327.267849:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599327.267901:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543290112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599327.267910:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787599327.267952:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b11180 x1874433543290112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599327.267973:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543290112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599327.268313:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543290368:0@lo:400:kworker.0 00000100:00100000:3.0:1787599327.268348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599327.268384:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599327.268390:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543290496:0@lo:400:kworker.0 00000100:00100000:3.0:1787599327.268412:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599327.268443:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543290368 00000100:00100000:3.0:1787599327.268447:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543290368 00000100:00100000:3.0:1787599327.269378:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543290496 00000100:00100000:3.0:1787599327.269386:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543290496 00000100:00100000:3.0:1787599327.269417:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787599327.269425:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543290368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599327.269572:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543290368:12345-0@lo:400:kworker.0 Request processed in 147us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599327.269580:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787599327.269596:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787599327.269602:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543290496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599327.269631:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543290496:12345-0@lo:400:kworker.0 Request processed in 30us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599327.269636:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787599327.269817:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543290624:0@lo:400:kworker.0 00000100:00100000:2.0:1787599327.269859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599327.269886:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787599327.269893:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543290240:0@lo:400:kworker.0 00000100:00100000:2.0:1787599327.269919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599327.269946:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543290752:0@lo:400:kworker.0 00000100:00100000:2.0:1787599327.269967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787599327.269996:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599327.270000:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599327.270015:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543290624 00000100:00100000:2.0:1787599327.270019:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543290624 00000100:00100000:2.0:1787599327.270057:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787599327.270065:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543290624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599327.270100:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543290624:12345-0@lo:400:kworker.0 Request processed in 36us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599327.270106:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787599327.270126:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543290240 00000100:00100000:2.0:1787599327.270130:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543290240 00000100:00100000:2.0:1787599327.270190:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787599327.270197:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543290240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599327.270418:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543290240:12345-0@lo:400:kworker.0 Request processed in 221us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599327.270426:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:2.0:1787599327.270725:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599327.270751:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543290240:0@lo:400:kworker.0 00010000:00080000:2.0:1787599327.270767:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b1f100 x1874433543290624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599327.270778:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543290624:0@lo:400:kworker.0 00000100:00100000:3.0:1787599327.270890:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543290752 00000100:00100000:3.0:1787599327.270895:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543290752 00000100:00100000:3.0:1787599327.270931:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787599327.270940:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543290752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599327.270998:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543290752:12345-0@lo:400:kworker.0 Request processed in 60us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599327.271005:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787599327.271048:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543290496:0@lo:400:kworker.0 00000100:00100000:3.0:1787599327.271059:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543290368:0@lo:400:kworker.0 00000100:00080000:2.0:1787599327.271134:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599327.272547:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543290752:0@lo:400:kworker.0 00010000:00010000:1.0:1787599328.232922:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599329.254856:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599330.275142:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599330.338256:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599330.338295:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543290880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599330.338392:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599330.338743:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543290880 00000100:00100000:1.0:1787599330.338761:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543290880 00000100:00100000:1.0:1787599330.338849:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787599330.338862:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543290880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599330.338900:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599330.338960:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543290880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599330.338969:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787599330.339022:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c91880 x1874433543290880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599330.339045:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543290880:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787599330.339182:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599330.952749:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599330.952814:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599330.952851:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599330.952942:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522285440 00000100:00100000:1.0:1787599330.952953:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522285440 00000100:00100000:1.0:1787599330.953021:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522285312 00000100:00100000:1.0:1787599330.953025:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522285312 00000100:00100000:1.0:1787599330.953050:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:1.0:1787599330.953060:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522285440:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599330.953150:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522285440:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 91us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599330.953187:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:1.0:1787599330.953209:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 90 00000100:00100000:1.0:1787599330.953216:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522285312:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599330.953242:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522285312:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599330.953248:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 90 00000100:00080000:2.0:1787599330.953431:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599330.955216:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522285184 00000100:00100000:0.0:1787599330.955231:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522285184 00000100:00100000:0.0:1787599330.955308:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 232 00000100:00100000:0.0:1787599330.955321:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522285184:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599330.955435:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522285184:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 117us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599330.955443:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 232 00010000:00010000:1.0:1787599331.297376:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787599332.299344:0:11148:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb18e98f0 20000000:00000080:0.0:1787599332.299360:0:11148:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f6c75f14000 uarg=0000000000000000 20000000:01000000:0.0:1787599332.299401:0:11148:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787599332.299408:0:11148:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787599332.299413:0:11148:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787599332.303192:0:11149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787599332.303427:0:11148:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787599332.311872:0:11148:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787599332.311906:0:11148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.311927:0:11148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c751fea00/0xa46cbc6741182615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070ef expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.311936:0:11148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c582d8e00/0xa46cbc6741182623 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118261c expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.311942:0:11148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c75618e00/0xa46cbc6741182631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118262a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.311947:0:11148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c582d9600/0xa46cbc674118263f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182638 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.311954:0:11148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c75619c00/0xa46cbc6741182654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07127 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.311960:0:11148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.312003:0:11148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c75619c00/0xa46cbc6741182654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07127 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.312019:0:11148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c75619c00/0xa46cbc6741182654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07127 expref: 12 pid: 5826 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599332.312033:0:11148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874433543291008:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599332.312193:0:11148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c582d9600/0xa46cbc674118263f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741182638 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.312233:0:11148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c582d9600/0xa46cbc674118263f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741182638 expref: 18 pid: 5825 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599332.312243:0:11148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874433543291136:0@lo:104: 00000100:00100000:2.0:1787599332.312301:0:11148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599332.312346:0:11148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c75618e00/0xa46cbc6741182631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc674118262a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.312354:0:11148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c75618e00/0xa46cbc6741182631 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc674118262a expref: 18 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599332.312362:0:11148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874433543291264:0@lo:104: 00000100:00100000:2.0:1787599332.312383:0:11148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599332.312403:0:11148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c582d8e00/0xa46cbc6741182623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc674118261c expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.312410:0:11148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c582d8e00/0xa46cbc6741182623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc674118261c expref: 18 pid: 5824 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599332.312418:0:11148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874433543291392:0@lo:104: 00000100:00100000:2.0:1787599332.312437:0:11148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787599332.312465:0:11148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c751fea00/0xa46cbc6741182615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070ef expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599332.312788:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543291136 00000100:00100000:0.0:1787599332.312796:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543291136 00000100:00100000:0.0:1787599332.312835:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543291264 00000100:00100000:0.0:1787599332.312838:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543291264 00000100:00100000:0.0:1787599332.312848:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543291392 00000100:00100000:0.0:1787599332.312850:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543291392 00000100:00100000:0.0:1787599332.312862:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787599332.312871:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:11148:x1874433543291136:12345-0@lo:104: 00010000:00010000:0.0:1787599332.312883:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.312938:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599332.312944:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:11148:x1874433543291136:12345-0@lo:104: Request processed in 74us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599332.312951:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787599332.312968:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787599332.312975:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:11148:x1874433543291264:12345-0@lo:104: 00010000:00010000:0.0:1787599332.312982:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313031:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787599332.313036:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:11148:x1874433543291264:12345-0@lo:104: Request processed in 63us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599332.313042:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787599332.313055:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787599332.313061:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:11148:x1874433543291392:12345-0@lo:104: 00010000:00010000:0.0:1787599332.313068:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313101:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787599332.313106:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:11148:x1874433543291392:12345-0@lo:104: Request processed in 46us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599332.313112:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787599332.313128:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787599332.313134:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313141:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:0.0:1787599332.313144:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313171:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599332.313178:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599332.313183:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787599332.313215:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313222:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599332.313243:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313250:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9200/0xa46cbc6741182638 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118263f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313264:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787599332.313268:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313301:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:0.0:1787599332.313304:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313310:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599332.313316:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599332.313320:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787599332.313333:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313338:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599332.313354:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313372:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24d200/0xa46cbc674118262a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182631 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313380:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599332.313383:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313388:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe600 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:0.0:1787599332.313391:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313398:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599332.313404:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599332.313409:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787599332.313422:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313427:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599332.313432:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313439:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc674118261c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741182623 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.313451:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599332.313458:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599332.313460:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599332.313468:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599332.313491:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543291648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599332.313526:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599332.313716:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543291776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599332.313746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599332.313768:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599332.313775:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543291904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599332.313796:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599332.313827:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543291648 00000100:00100000:0.0:1787599332.313832:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543291648 00010000:00010000:0.0:1787599332.313851:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c582d9600/0xa46cbc674118263f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182638 expref: 19 pid: 5825 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599332.313872:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543291776 00000100:00100000:0.0:1787599332.313875:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543291776 00010000:00010000:0.0:1787599332.313886:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c75618e00/0xa46cbc6741182631 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118262a expref: 20 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599332.313896:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543291904 00000100:00100000:0.0:1787599332.313899:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543291904 00010000:00010000:0.0:1787599332.313909:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c582d8e00/0xa46cbc6741182623 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118261c expref: 21 pid: 5824 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599332.313922:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787599332.313929:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58443850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+21:3302:x1874433543291648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599332.313939:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599332.313944:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c582d9600/0xa46cbc674118263f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182638 expref: 21 pid: 5825 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599332.314243:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599332.314255:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+21:3299:x1874433543291776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599332.314263:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599332.314268:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c75618e00/0xa46cbc6741182631 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118262a expref: 21 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.314665:0:11148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c751fea00/0xa46cbc6741182615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070ef expref: 12 pid: 5825 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599332.314682:0:11148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874433543291520:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599332.314754:0:11148:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7660a780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599332.314776:0:11148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874433543291136:0@lo:104: 00000100:00100000:2.0:1787599332.314786:0:11148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874433543291264:0@lo:104: 00000100:00100000:2.0:1787599332.314794:0:11148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874433543291392:0@lo:104: 00000100:00100000:2.0:1787599332.318362:0:11148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874433543291008:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599332.318381:0:11148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874433543291520:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599332.320243:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599332.320284:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:0.0:1787599332.320879:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c582d9600/0xa46cbc674118263f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741182638 expref: 21 pid: 5825 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.320908:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d9600/0xa46cbc674118263f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741182638 expref: 21 pid: 5825 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.320923:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599332.320993:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58443850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+20:3302:x1874433543291648:12345-0@lo:103:ldlm_bl.0 Request processed in 7063us (7464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599332.321003:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787599332.321068:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522285568 00000100:00100000:0.0:1787599332.321076:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522285568 00010000:00010000:0.0:1787599332.321104:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c75619c00/0xa46cbc6741182654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07127 expref: 13 pid: 5826 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599332.321121:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522285696 00000100:00100000:0.0:1787599332.321124:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522285696 00010000:00010000:0.0:1787599332.321136:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c751fea00/0xa46cbc6741182615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070ef expref: 14 pid: 5825 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599332.321149:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787599332.321178:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543291904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599332.321191:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599332.321196:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c582d8e00/0xa46cbc6741182623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118261c expref: 19 pid: 5824 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.321204:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c582d8e00/0xa46cbc6741182623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc674118261c expref: 19 pid: 5824 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.321245:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d8e00/0xa46cbc6741182623 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc674118261c expref: 19 pid: 5824 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.321254:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599332.321297:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:3299:x1874433543291904:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (7499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599332.321304:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787599332.321319:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:0.0:1787599332.321326:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+14:2359:x1874433522285568:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599332.321335:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599332.321340:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c75619c00/0xa46cbc6741182654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07127 expref: 14 pid: 5826 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.321353:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c75619c00/0xa46cbc6741182654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07127 expref: 14 pid: 5826 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.321364:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75619c00/0xa46cbc6741182654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07127 expref: 14 pid: 5826 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.321373:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599332.321411:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2359:x1874433522285568:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 85us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599332.321417:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:0.0:1787599332.321429:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:0.0:1787599332.321435:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:2359:x1874433522285696:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599332.321454:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599332.321464:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c751fea00/0xa46cbc6741182615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070ef expref: 12 pid: 5825 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.322013:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c751fea00/0xa46cbc6741182615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070ef expref: 12 pid: 5825 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.322027:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751fea00/0xa46cbc6741182615 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070ef expref: 12 pid: 5825 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.322038:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599332.322069:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:2359:x1874433522285696:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 633us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599332.322076:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:0.0:1787599332.322145:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543291648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599332.322206:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543291904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599332.322288:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c75618e00/0xa46cbc6741182631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc674118262a expref: 17 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322302:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75618e00/0xa46cbc6741182631 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc674118262a expref: 17 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322313:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322321:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322337:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322346:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322353:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322360:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322366:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599332.322381:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322389:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322397:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599332.322407:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599332.322460:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3299:x1874433543291776:12345-0@lo:103:ldlm_bl.0 Request processed in 8209us (8713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599332.322467:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787599332.323064:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543291776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599332.323964:0:11148:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.324033:0:11148:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.324039:0:11148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599332.324046:0:11148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75619400/0xa46cbc6741182670 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599332.324336:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599332.396701:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543292160:0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.396774:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599332.396834:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787599332.396840:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543292032:0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.396862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599332.396880:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543292544:0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.396902:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599332.396933:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543292288:0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.396955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599332.396973:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599332.396978:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543292416:0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.396999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599332.397031:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543292160 00000100:00100000:1.0:1787599332.397040:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543292160 00000100:00100000:1.0:1787599332.397092:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543292032 00000100:00100000:1.0:1787599332.397109:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543292032 00000100:00100000:1.0:1787599332.397125:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543292416 00000100:00100000:1.0:1787599332.397128:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543292416 00000100:00100000:1.0:1787599332.397145:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787599332.397182:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543292160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.397234:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543292160:12345-0@lo:400:kworker.0 Request processed in 81us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599332.397241:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787599332.397259:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787599332.397266:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543292032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.397306:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543292032:12345-0@lo:400:kworker.0 Request processed in 41us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599332.397311:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787599332.397324:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787599332.397330:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543292416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.397360:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543292416:12345-0@lo:400:kworker.0 Request processed in 31us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599332.397365:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787599332.397386:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543292544 00000100:00100000:1.0:1787599332.397389:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543292544 00000100:00100000:1.0:1787599332.397412:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543292288 00000100:00100000:1.0:1787599332.397415:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543292288 00000100:00100000:1.0:1787599332.397426:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787599332.397432:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543292544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.397462:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543292544:12345-0@lo:400:kworker.0 Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599332.397467:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787599332.397484:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787599332.397490:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543292288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.397520:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543292288:12345-0@lo:400:kworker.0 Request processed in 30us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599332.397528:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787599332.397549:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599332.397552:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599332.397554:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599332.397585:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543292416:0@lo:400:kworker.0 00010000:00080000:1.0:1787599332.397598:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c92d80 x1874433543292288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599332.397607:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543292288:0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.397638:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543292032:0@lo:400:kworker.0 00010000:00080000:1.0:1787599332.397647:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75c90000 x1874433543292544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599332.397655:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543292544:0@lo:400:kworker.0 00000100:00100000:1.0:1787599332.397664:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543292160:0@lo:400:kworker.0 00000100:00100000:0.0:1787599332.398863:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599332.398882:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543292672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599332.398936:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599332.400001:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543292672 00000100:00100000:3.0:1787599332.400012:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543292672 00000100:00100000:3.0:1787599332.400079:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787599332.400091:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543292672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599332.400127:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599332.400207:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543292672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599332.400214:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787599332.400336:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b1dc00 x1874433543292672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599332.400357:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543292672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787599333.346074:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599333.377032:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599333.377214:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522285824 00000100:00100000:0.0:1787599333.377227:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522285824 00000100:00100000:0.0:1787599333.377318:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 233 00000100:00100000:0.0:1787599333.377330:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:5598:x1874433522285824:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599333.377351:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599333.377371:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741182677 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07151 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599333.377404:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741182677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07151 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599333.377414:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741182677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07151 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599333.377424:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff200, rc 0) 00000100:00100000:0.0:1787599333.377491:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522285824:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 162us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599333.377498:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 233 00000100:00100000:3.0:1787599333.385983:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599333.386179:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522285952 00000100:00100000:2.0:1787599333.386190:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522285952 00000100:00100000:2.0:1787599333.386262:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 234 00000100:00100000:2.0:1787599333.386273:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522285952:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599333.386672:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522285952:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 399us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599333.386681:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 234 00000100:00100000:3.0:1787599333.390430:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599333.391078:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522286080 00000100:00100000:2.0:1787599333.391090:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522286080 00000100:00100000:2.0:1787599333.391200:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 235 00000100:00100000:2.0:1787599333.391211:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522286080:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599333.391464:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522286080:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 254us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599333.391473:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 235 00000100:00100000:3.0:1787599333.418369:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599333.422746:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522286208 00000100:00100000:0.0:1787599333.422764:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522286208 00000100:00100000:0.0:1787599333.422857:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 236 00000100:00100000:0.0:1787599333.422869:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522286208:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599333.422895:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599333.422914:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751fee00/0xa46cbc674118267e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07158 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599333.422942:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fee00/0xa46cbc674118267e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07158 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599333.422953:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751fee00/0xa46cbc674118267e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07158 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599333.422975:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fee00, rc 0) 00000100:00100000:0.0:1787599333.423036:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:5598:x1874433522286208:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 170us (4677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599333.423043:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 236 00000100:00100000:3.0:1787599333.431695:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599333.431782:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522286336 00000100:00100000:0.0:1787599333.431795:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522286336 00000100:00100000:0.0:1787599333.431858:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 237 00000100:00100000:0.0:1787599333.431870:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:5598:x1874433522286336:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599333.432384:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:5598:x1874433522286336:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 514us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599333.432394:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 237 00000100:00100000:1.0:1787599333.441081:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599333.453607:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522286464 00000100:00100000:3.0:1787599333.453642:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522286464 00000100:00100000:3.0:1787599333.453711:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 238 00000100:00100000:3.0:1787599333.453723:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:5598:x1874433522286464:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599333.454024:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:5598:x1874433522286464:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 302us (12953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599333.454311:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 238 10000000:01000000:1.0:1787599334.181926:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787599334.181934:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6b4432d000 from 7 10000000:01000000:1.0:1787599334.181939:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787599334.181991:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599334.182004:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599334.182034:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599334.182062:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7013b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543292800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599334.182132:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599334.182216:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599334.184196:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543292800 00000100:00100000:0.0:1787599334.184212:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543292800 00000100:00100000:0.0:1787599334.184292:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787599334.184305:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543292800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599334.184323:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599334.184340:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118268c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182685 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.184370:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118268c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182685 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.184381:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118268c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182685 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.184392:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff400, rc 0) 00000100:00100000:0.0:1787599334.184490:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543292800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599334.184497:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787599334.184572:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7013b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543292800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599334.184592:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.184602:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599334.184686:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543292928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599334.184727:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599334.184759:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58d9b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599334.184773:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543292928 00000100:00100000:0.0:1787599334.184777:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543292928 00000100:00100000:0.0:1787599334.184800:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787599334.184807:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543292928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599334.185093:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543292928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599334.185100:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787599334.185130:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543292928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599334.185186:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599334.185228:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599334.185263:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c582973c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599334.185275:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543293056 00000100:00100000:0.0:1787599334.185278:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543293056 00000100:00100000:0.0:1787599334.185304:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787599334.185310:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543293056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599334.185449:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543293056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599334.185456:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787599334.185494:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787599334.186115:0:11172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787599334.186201:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787599334.186217:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599334.186226:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.186250:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599334.186262:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599334.186265:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c50231800 from 7 10000000:01000000:0.0:1787599334.186267:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599334.186293:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.186301:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.186309:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599334.186326:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599334.186361:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599334.186387:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48bb03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599334.186401:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543293184 00000100:00100000:0.0:1787599334.186406:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543293184 00000100:00100000:0.0:1787599334.186432:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787599334.186441:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543293184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599334.186450:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599334.186461:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751ff800/0xa46cbc674118269a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741182693 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.186480:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ff800/0xa46cbc674118269a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741182693 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.186489:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751ff800/0xa46cbc674118269a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182693 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.186497:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff800, rc 0) 00000100:00100000:0.0:1787599334.186528:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543293184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599334.186534:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787599334.186568:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599334.186581:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599334.186589:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599334.186629:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599334.186654:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599334.186673:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48bb03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599334.186684:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543293312 00000100:00100000:0.0:1787599334.186687:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543293312 00000100:00100000:0.0:1787599334.186708:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787599334.186714:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543293312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599334.186908:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543293312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599334.186915:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787599334.186945:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599334.189666:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599334.189762:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599334.189809:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48bb03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599334.189913:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543293440 00000100:00100000:2.0:1787599334.189922:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543293440 00000100:00100000:2.0:1787599334.189977:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787599334.189988:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543293440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599334.190466:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543293440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 478us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599334.190473:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787599334.190720:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787599334.191391:0:11173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787599334.191451:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787599334.191477:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599334.191487:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599334.191499:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599334.191523:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599334.191526:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c6dd51000 from 7 10000000:01000000:3.0:1787599334.191529:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599334.191563:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599334.191571:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599334.191581:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599334.191604:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599334.191662:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599334.191692:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c43e8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599334.191709:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543293568 00000100:00100000:3.0:1787599334.191714:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543293568 00000100:00100000:3.0:1787599334.191743:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787599334.191751:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543293568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599334.191762:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599334.191772:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c5b24d000/0xa46cbc67411826a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411826a1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599334.191793:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c5b24d000/0xa46cbc67411826a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411826a1 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599334.191802:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c5b24d000/0xa46cbc67411826a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411826a1 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599334.191811:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d000, rc 0) 00000100:00100000:3.0:1787599334.191843:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543293568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599334.191850:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787599334.191884:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599334.191896:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599334.191905:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599334.191951:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599334.191983:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599334.191999:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c43e8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599334.192010:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543293696 00000100:00100000:3.0:1787599334.192013:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543293696 00000100:00100000:3.0:1787599334.192032:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787599334.192038:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543293696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599334.192368:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543293696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599334.192375:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787599334.192412:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599334.192448:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599334.192488:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599334.192504:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c43e8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599334.192517:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543293824 00000100:00100000:3.0:1787599334.192520:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543293824 00000100:00100000:3.0:1787599334.192540:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787599334.192545:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543293824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599334.192686:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543293824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599334.192693:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787599334.192728:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543293824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787599334.194690:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787599334.194852:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787599334.194874:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599334.194886:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599334.194918:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599334.369671:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599335.396079:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599335.463383:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599335.463410:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543293952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599335.463488:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599335.463565:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543293952 00000100:00100000:3.0:1787599335.463573:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543293952 00000100:00100000:3.0:1787599335.463630:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599335.463642:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543293952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599335.463677:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599335.463732:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543293952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599335.463740:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787599335.463759:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787599335.464071:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b1e300 x1874433543293952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599335.464094:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543293952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599336.077447:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599336.077485:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599336.077554:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599336.077604:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522286592 00000100:00100000:2.0:1787599336.077615:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522286592 00000100:00100000:2.0:1787599336.077683:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 248 00000100:00100000:2.0:1787599336.077694:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522286592:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599336.077803:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522286592:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 110us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599336.077812:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 248 00000100:00100000:1.0:1787599336.079149:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522286848 00000100:00100000:1.0:1787599336.079224:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522286848 00000100:00100000:1.0:1787599336.079285:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522286720 00000100:00100000:1.0:1787599336.079289:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522286720 00000100:00100000:1.0:1787599336.079315:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 94 00000100:00100000:1.0:1787599336.079324:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522286848:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599336.079382:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522286848:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 60us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.079389:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 94 00000100:00100000:1.0:1787599336.079406:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 95 00000100:00100000:1.0:1787599336.079412:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522286720:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599336.079433:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522286720:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599336.079439:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 95 00000100:00080000:0.0:1787599336.080581:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787599336.426513:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599337.441434:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599337.507577:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599337.507605:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543294080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599337.507681:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599337.507776:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543294080 00000100:00100000:3.0:1787599337.507785:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543294080 00000100:00100000:3.0:1787599337.507845:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599337.507857:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543294080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599337.507912:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599337.507962:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543294080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599337.507969:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787599337.507989:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787599337.508020:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b1e300 x1874433543294080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599337.508039:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543294080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599337.508430:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543294592:0@lo:400:kworker.0 00000100:00100000:2.0:1787599337.508465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599337.508489:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599337.508495:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543294464:0@lo:400:kworker.0 00000100:00100000:2.0:1787599337.508521:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599337.508632:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543294208:0@lo:400:kworker.0 00000100:00100000:0.0:1787599337.508672:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599337.508700:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543294720:0@lo:400:kworker.0 00000100:00100000:0.0:1787599337.508724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599337.508760:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599337.508767:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543294336:0@lo:400:kworker.0 00000100:00100000:0.0:1787599337.508791:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599337.508820:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543294208 00000100:00100000:0.0:1787599337.508831:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543294208 00000100:00100000:0.0:1787599337.508865:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787599337.508873:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543294208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599337.508914:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543294208:12345-0@lo:400:kworker.0 Request processed in 41us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599337.508921:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787599337.508951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543294464 00000100:00100000:0.0:1787599337.508956:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543294464 00000100:00100000:0.0:1787599337.508982:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543294720 00000100:00100000:0.0:1787599337.508985:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543294720 00000100:00100000:0.0:1787599337.508998:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543294336 00000100:00100000:0.0:1787599337.509001:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543294336 00000100:00100000:0.0:1787599337.509014:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787599337.509021:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543294464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599337.509055:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543294464:12345-0@lo:400:kworker.0 Request processed in 35us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599337.509062:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787599337.509074:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787599337.509081:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543294720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599337.509108:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543294720:12345-0@lo:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599337.509114:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787599337.509125:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787599337.509131:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543294336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599337.509191:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543294336:12345-0@lo:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599337.509198:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787599337.509244:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543294336:0@lo:400:kworker.0 00000100:00100000:0.0:1787599337.509255:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543294208:0@lo:400:kworker.0 00000100:00100000:0.0:1787599337.509404:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543294720:0@lo:400:kworker.0 00000100:00100000:2.0:1787599337.509501:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543294464:0@lo:400:kworker.0 00000100:00100000:2.0:1787599337.509523:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543294592 00000100:00100000:2.0:1787599337.509527:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543294592 00000100:00100000:2.0:1787599337.509909:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787599337.509920:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543294592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599337.509972:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543294592:12345-0@lo:400:kworker.0 Request processed in 56us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599337.509979:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787599337.510016:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c750fb100 x1874433543294592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599337.510028:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543294592:0@lo:400:kworker.0 00000100:00080000:3.0:1787599337.510185:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599337.510191:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787599337.954518:0:11346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787599338.465901:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599339.489676:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599340.523305:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599340.579237:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599340.579272:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543294848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599340.579377:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599340.579473:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543294848 00000100:00100000:2.0:1787599340.579483:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543294848 00000100:00100000:2.0:1787599340.579559:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787599340.579572:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543294848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599340.579624:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599340.579682:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543294848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599340.579690:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1787599340.579716:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787599340.579755:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b1e300 x1874433543294848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599340.579785:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543294848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599341.188531:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599341.188602:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599341.188639:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599341.188688:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522287232 00000100:00100000:1.0:1787599341.188701:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522287232 00000100:00100000:1.0:1787599341.188772:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522287104 00000100:00100000:1.0:1787599341.188776:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522287104 00000100:00100000:1.0:1787599341.188803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:1.0:1787599341.188815:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522287232:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599341.188917:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522287232:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 104us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599341.188925:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:1.0:1787599341.188944:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 100 00000100:00100000:1.0:1787599341.188950:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522287104:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599341.188977:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522287104:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599341.188982:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 100 00000100:00080000:1.0:1787599341.189002:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599341.189112:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522286976 00000100:00100000:3.0:1787599341.189118:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522286976 00000100:00100000:3.0:1787599341.189154:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 250 00000100:00100000:3.0:1787599341.189194:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522286976:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599341.189241:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522286976:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 49us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599341.189248:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 250 00010000:00010000:0.0:1787599341.542972:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599342.563791:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599342.625935:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543295360:0@lo:400:kworker.0 00000100:00100000:0.0:1787599342.626043:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599342.626137:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599342.626144:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543295232:0@lo:400:kworker.0 00000100:00100000:0.0:1787599342.626221:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599342.626265:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543295360 00000100:00100000:0.0:1787599342.626275:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543295360 00000100:00100000:0.0:1787599342.626375:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787599342.626387:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543295360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599342.626458:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543295360:12345-0@lo:400:kworker.0 Request processed in 72us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599342.626466:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787599342.626496:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543295232 00000100:00100000:0.0:1787599342.626501:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543295232 00000100:00100000:0.0:1787599342.626536:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787599342.626543:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543295232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599342.626578:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543295232:12345-0@lo:400:kworker.0 Request processed in 35us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599342.626585:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1787599342.626602:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599342.626607:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599342.626662:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543295232:0@lo:400:kworker.0 00010000:00080000:0.0:1787599342.626675:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b12300 x1874433543295360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599342.626686:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543295360:0@lo:400:kworker.0 00000100:00100000:2.0:1787599342.626806:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543294976:0@lo:400:kworker.0 00000100:00100000:2.0:1787599342.626853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599342.626892:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543295488:0@lo:400:kworker.0 00000100:00100000:2.0:1787599342.626916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599342.626938:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787599342.626944:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543295104:0@lo:400:kworker.0 00000100:00100000:2.0:1787599342.626964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599342.626980:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543295616:0@lo:400:kworker.0 00000100:00100000:2.0:1787599342.627000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599342.627032:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543295616 00000100:00100000:2.0:1787599342.627036:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543295616 00000100:00100000:2.0:1787599342.627087:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599342.627097:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543295616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599342.627136:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543295616:12345-0@lo:400:kworker.0 Request processed in 41us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599342.627144:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599342.627199:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543295488 00000100:00100000:2.0:1787599342.627203:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543295488 00000100:00100000:2.0:1787599342.627244:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543295104 00000100:00100000:2.0:1787599342.627247:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543295104 00000100:00100000:2.0:1787599342.627266:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787599342.627273:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543295488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599342.627307:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543295488:12345-0@lo:400:kworker.0 Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599342.627313:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787599342.627338:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787599342.627344:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543295104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599342.627375:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543295104:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599342.627382:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787599342.627411:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599342.627415:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599342.627440:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543295104:0@lo:400:kworker.0 00010000:00080000:2.0:1787599342.627451:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b10700 x1874433543295616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599342.627462:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543295616:0@lo:400:kworker.0 00000100:00100000:2.0:1787599342.627472:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543295488:0@lo:400:kworker.0 00000100:00100000:2.0:1787599342.628870:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599342.628906:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543295744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599342.628987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599342.629043:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543295744 00000100:00100000:2.0:1787599342.629051:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543295744 00000100:00100000:2.0:1787599342.629120:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787599342.629131:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543295744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599342.629202:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599342.629252:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543295744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599342.629260:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787599342.629309:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c750f9180 x1874433543295744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599342.629369:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543295744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599342.630283:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543294976 00000100:00100000:0.0:1787599342.630297:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543294976 00000100:00100000:0.0:1787599342.630735:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787599342.630746:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543294976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599342.632325:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543294976:12345-0@lo:400:kworker.0 Request processed in 1570us (5460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599342.632340:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787599342.635492:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543294976:0@lo:400:kworker.0 00000001:02000400:3.0:1787599342.856578:0:11446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:22:20 (1787599340) === 00000100:00100000:2.0:1787599343.135904:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.136931:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599343.137092:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522287488 00000100:00100000:1.0:1787599343.137109:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522287488 00000100:00100000:1.0:1787599343.137260:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1787599343.137281:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:9689:x1874433522287488:12345-192.168.204.30@tcp:700:mkdir.0 00000100:00080000:2.0:1787599343.137302:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599343.137434:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:9689:x1874433522287488:12345-192.168.204.30@tcp:700:mkdir.0 Request processed in 159us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599343.137444:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:0.0:1787599343.141118:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522287360 00000100:00100000:0.0:1787599343.141142:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522287360 00000100:00100000:0.0:1787599343.142647:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:0.0:1787599343.142672:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522287360:12345-192.168.204.30@tcp:41:mkdir.0 00000004:00000024:0.0:1787599343.142744:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787599343.142910:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522287360:12345-192.168.204.30@tcp:41:mkdir.0 Request processed in 242us (7022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599343.142918:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:2.0:1787599343.146810:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599343.146906:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522287744 00000100:00100000:0.0:1787599343.146925:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522287744 00000100:00100000:0.0:1787599343.147026:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1787599343.147040:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:9689:x1874433522287744:12345-192.168.204.30@tcp:36:mkdir.0 00010000:00010000:0.0:1787599343.147140:0:8189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599343.147390:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182590 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070da expref: 6 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.147432:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:0.0:1787599343.147446:0:8189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599343.147817:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.147832:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.147842:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.147896:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.147905:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.147912:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599343.149203:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787599343.149218:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.149226:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826af lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.149233:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.149240:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599343.149251:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.149257:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826af lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.149271:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:0.0:1787599343.149274:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599343.149278:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.149283:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599343.149298:0:8189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085b438c1 reply state 0000000008df6830 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599343.149307:0:8189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599343.149424:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:9689:x1874433522287744:12345-192.168.204.30@tcp:36:mkdir.0 Request processed in 2384us (2623us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787599343.149432:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00010000:00010000:0.0:1787599343.157699:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.157721:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.157730:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.157737:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599343.157743:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.157768:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.157789:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599343.157793:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599343.157797:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.157803:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826b6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599343.174316:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599343.174439:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522287872 00000100:00100000:0.0:1787599343.174450:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522287872 00000100:00100000:0.0:1787599343.174516:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:0.0:1787599343.174529:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:9690:x1874433522287872:12345-192.168.204.30@tcp:101:chmod.0 00010000:00010000:0.0:1787599343.174554:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599343.174579:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0715f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.174647:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.174661:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.174671:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599343.174732:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787599343.174750:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599343.174800:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.174827:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0715f expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.174846:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0715f expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.174855:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599343.174858:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599343.174861:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff600, rc 0) 00000100:00100000:0.0:1787599343.174921:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:9690:x1874433522287872:12345-192.168.204.30@tcp:101:chmod.0 Request processed in 394us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599343.174928:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1787599343.184321:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599343.185045:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522288128 00000100:00100000:0.0:1787599343.185072:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522288128 00000100:00100000:0.0:1787599343.185216:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:0.0:1787599343.185230:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:9690:x1874433522288128:12345-192.168.204.30@tcp:36:chmod.0 00010000:00010000:0.0:1787599343.185310:0:8189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599343.185359:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0715f expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.185385:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599343.185400:0:8189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599343.185434:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.185474:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.185485:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599343.190779:0:8189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b124b9a reply state 0000000027708ebb transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599343.190807:0:8189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787599343.190867:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787599343.191058:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:9690:x1874433522288128:12345-192.168.204.30@tcp:36:chmod.0 Request processed in 5822us (6746us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787599343.191082:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00010000:00010000:3.0:1787599343.195967:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.195993:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.196002:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.196029:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599343.196035:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.196044:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.196084:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:3.0:1787599343.196088:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787599343.196094:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.196100:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826cb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599343.217984:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599343.218240:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522288256 00000100:00100000:0.0:1787599343.218255:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522288256 00000100:00100000:0.0:1787599343.218341:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1787599343.218354:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:9691:x1874433522288256:12345-192.168.204.30@tcp:101:chown.0 00010000:00010000:0.0:1787599343.218880:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599343.218915:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07166 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.219020:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.219038:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.219051:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599343.219207:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787599343.219212:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599343.219271:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.219306:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07166 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.219328:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07166 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.219338:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599343.219341:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599343.219345:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe000, rc 0) 00000100:00100000:0.0:1787599343.219825:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:9691:x1874433522288256:12345-192.168.204.30@tcp:101:chown.0 Request processed in 1470us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599343.219836:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:1.0:1787599343.238897:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599343.239070:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522288384 00000100:00100000:0.0:1787599343.239085:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522288384 00000100:00100000:0.0:1787599343.239210:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1787599343.239225:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:9691:x1874433522288384:12345-192.168.204.30@tcp:101:chown.0 00010000:00010000:0.0:1787599343.239255:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599343.239288:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0716d expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239392:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411826e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239594:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411826e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239610:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411826e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239631:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411826ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239650:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411826ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239657:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411826ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239793:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411826f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239802:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411826f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239809:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411826f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599343.239859:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787599343.239864:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599343.239889:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411826f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239903:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411826e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239921:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411826e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239929:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411826e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239936:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599343.239941:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411826e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239950:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411826e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239965:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599343.239969:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599343.239975:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411826e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239981:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411826e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.239998:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411826ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.240004:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411826ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.240010:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411826ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.240016:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599343.240026:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411826ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.240033:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411826ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.240041:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f6c43a07f00) 00010000:00010000:0.0:1787599343.240043:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599343.240046:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411826ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.240053:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411826ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.240107:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc67411826e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0716d expref: 10 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.240121:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411826f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0716d expref: 9 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.240129:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c43a07c00) 00010000:00010000:0.0:1787599343.240131:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599343.240134:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ffa00, rc 0) 00000100:00100000:0.0:1787599343.240274:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:9691:x1874433522288384:12345-192.168.204.30@tcp:101:chown.0 Request processed in 1052us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599343.240283:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:1.0:1787599343.243411:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.243568:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522288640 00000100:00100000:2.0:1787599343.243581:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522288640 00000100:00100000:2.0:1787599343.243656:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1787599343.243669:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:9691:x1874433522288640:12345-192.168.204.30@tcp:36:chown.0 00010000:00010000:2.0:1787599343.243746:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599343.243789:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411826f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0716d expref: 9 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.243819:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c43a07c00) 00010000:00010000:2.0:1787599343.243834:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599343.243885:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.243900:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.243911:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599343.323486:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1787599343.323518:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787599343.323683:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000685566c7 reply state 00000000960aafc1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599343.323701:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787599343.323957:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787599343.324125:0:5832:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787599343.324152:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:9691:x1874433522288640:12345-192.168.204.30@tcp:36:chown.0 Request processed in 80479us (80748us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787599343.324191:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00010000:00010000:1.0:1787599343.324245:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.324256:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.324263:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.324271:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599343.324277:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.324286:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.324307:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c70382200) 00010000:00010000:1.0:1787599343.324311:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787599343.324316:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.324323:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411826fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599343.354599:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599343.355304:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522288768 00000100:00100000:0.0:1787599343.355320:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522288768 00000100:00100000:0.0:1787599343.355433:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1787599343.355445:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:9692:x1874433522288768:12345-192.168.204.30@tcp:101:touch.500 00010000:00010000:0.0:1787599343.355480:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599343.355508:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07174 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599343.356739:0:8189:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1162us 00010000:00010000:3.0:1787599343.403809:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118270a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.403850:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118270a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.403863:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118270a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.403883:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.403891:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.403897:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404411:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741182718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404421:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741182718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404429:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741182718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599343.404504:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787599343.404509:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599343.404599:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741182718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404615:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118270a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404622:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118270a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404630:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118270a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404649:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599343.404654:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118270a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404661:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118270a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404675:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:3.0:1787599343.404684:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599343.404689:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118270a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404696:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118270a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404710:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404716:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182711 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404723:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404728:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599343.404731:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404736:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182711 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404742:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f6c70860400) 00010000:00010000:3.0:1787599343.404744:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599343.404747:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182711 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404752:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182711 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404796:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07174 expref: 8 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404822:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741182718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07174 expref: 7 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.404830:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:3.0:1787599343.404832:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787599343.404834:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24ce00, rc 0) 00000100:00100000:3.0:1787599343.404936:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:9692:x1874433522288768:12345-192.168.204.30@tcp:101:touch.500 Request processed in 49493us (50357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599343.404945:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:1.0:1787599343.412814:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599343.421002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522289024 00000100:00100000:0.0:1787599343.421026:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522289024 00000100:00100000:0.0:1787599343.422803:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:0.0:1787599343.422829:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:9692:x1874433522289024:12345-192.168.204.30@tcp:101:touch.500 00010000:00010000:0.0:1787599343.422868:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599343.422899:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118271f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0717b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.423506:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182726 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.423528:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182726 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.423542:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182726 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.423860:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.423886:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.423899:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787599343.429837:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787599343.431883:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe600/0xa46cbc6741182734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.431909:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe600/0xa46cbc6741182734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.431922:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe600/0xa46cbc6741182734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.431964:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182726 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.431972:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182726 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.431979:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182726 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.431986:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ffe00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599343.431991:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182726 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.431999:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182726 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.432013:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:0.0:1787599343.432017:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599343.432022:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182726 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.432039:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182726 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599343.433864:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c4949dc reply state 000000008c33c52a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599343.433886:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787599343.433954:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118271f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0717b expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.433980:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe600/0xa46cbc6741182734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0717b expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599343.433989:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f6c43a07a00) 00010000:00010000:0.0:1787599343.433992:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599343.433995:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe600, rc 0) 00000100:00100000:0.0:1787599343.434092:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:9692:x1874433522289024:12345-192.168.204.30@tcp:101:touch.500 Request processed in 11272us (21294us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787599343.434101:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00010000:00010000:1.0:1787599343.448574:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.448601:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.448611:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.448618:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599343.448624:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.448633:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.448659:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff9f6c43a07f00) 00010000:00010000:1.0:1787599343.448662:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599343.448669:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.448675:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118272d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599343.454297:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.454757:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522289280 00000100:00100000:2.0:1787599343.454772:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522289280 00000100:00100000:2.0:1787599343.454851:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:2.0:1787599343.454888:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:9692:x1874433522289280:12345-192.168.204.30@tcp:36:touch.500 00010000:00010000:2.0:1787599343.454974:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599343.455012:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe600/0xa46cbc6741182734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0717b expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.455037:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f6c43a07a00) 00010000:00010000:2.0:1787599343.455049:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599343.455124:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.455143:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.455204:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599343.455388:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfee9aac reply state 00000000e7dd702c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599343.455400:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599343.455528:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:9692:x1874433522289280:12345-192.168.204.30@tcp:36:touch.500 Request processed in 645us (1246us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787599343.455536:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00010000:00010000:1.0:1787599343.458310:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.458362:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.458371:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.458378:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599343.458385:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.458394:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.458424:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f6c70382300) 00010000:00010000:1.0:1787599343.458429:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599343.458435:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.458440:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182742 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599343.460906:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599343.462959:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522289408 00000100:00100000:1.0:1787599343.462980:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522289408 00000100:00100000:1.0:1787599343.463078:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1787599343.463091:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:9692:x1874433522289408:12345-192.168.204.30@tcp:101:touch.500 00010000:00010000:1.0:1787599343.463127:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599343.463188:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182749 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07182 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.463274:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182749 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07182 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.463310:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182749 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07182 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.463335:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f6c50836300) 00010000:00010000:1.0:1787599343.463338:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599343.463343:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8a00, rc 0) 00000100:00100000:1.0:1787599343.463439:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:9692:x1874433522289408:12345-192.168.204.30@tcp:101:touch.500 Request processed in 350us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599343.463456:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:0.0:1787599343.474332:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.474434:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522289536 00000100:00100000:2.0:1787599343.474447:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522289536 00000100:00100000:2.0:1787599343.474514:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:2.0:1787599343.474527:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874433522289536:12345-192.168.204.30@tcp:8:touch.500 00010000:00080000:2.0:1787599343.474574:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:2.0:1787599343.474615:0:6679:0:(genops.c:1385:class_connect()) connect: client 3d8318fd-1d0f-4438-bc2c-ebacb6a98551, cookie 0xa46cbc6741182750 00002000:00100000:2.0:1787599343.474765:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3d8318fd-1d0f-4438-bc2c-ebacb6a98551/ffff9f6b44a78800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787599343.474798:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787599343.475511:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787599343.475560:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9f6b44364800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599343.476823:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2355:x1874433522289536:12345-192.168.204.30@tcp:8:touch.500 Request processed in 2284us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599343.476851:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:2.0:1787599343.498560:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599343.498751:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522289664 00000100:00100000:0.0:1787599343.498765:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522289664 00000100:00100000:0.0:1787599343.498879:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:0.0:1787599343.498892:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:0:x1874433522289664:12345-192.168.204.30@tcp:2:touch.500 00000100:00080000:2.0:1787599343.503430:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787599343.585876:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787599343.597474:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1787599343.597516:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000100:00100000:3.0:1787599343.597821:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:0:x1874433522289664:12345-192.168.204.30@tcp:2:touch.500 Request processed in 98922us (99266us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787599343.597835:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:0.0:1787599343.601329:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.601641:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522289920 00000100:00100000:2.0:1787599343.601657:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522289920 00000100:00100000:2.0:1787599343.601734:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:2.0:1787599343.601748:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:9692:x1874433522289920:12345-192.168.204.30@tcp:35:touch.500 00000100:00100000:2.0:1787599343.602310:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+11:9692:x1874433522289920:12345-192.168.204.30@tcp:35:touch.500 Request processed in 562us (993us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787599343.602320:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:0.0:1787599343.625243:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599343.625368:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522290048 00000100:00100000:3.0:1787599343.625382:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522290048 00000100:00100000:3.0:1787599343.625455:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:3.0:1787599343.625470:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+11:9693:x1874433522290048:12345-192.168.204.30@tcp:101:rm.0 00010000:00010000:3.0:1787599343.625503:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599343.625532:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07189 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.625618:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118275e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.625738:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.625753:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599343.625850:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787599343.625854:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599343.625911:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.626284:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741182757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07189 expref: 13 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.626307:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118275e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07189 expref: 12 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.626317:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:3.0:1787599343.626461:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599343.626467:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d600, rc 0) 00000100:00100000:2.0:1787599343.630694:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:9693:x1874433522290048:12345-192.168.204.30@tcp:101:rm.0 Request processed in 5208us (5446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599343.630712:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:1.0:1787599343.634223:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599343.635181:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522290304 00000100:00100000:3.0:1787599343.635198:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522290304 00000100:00100000:3.0:1787599343.635287:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:3.0:1787599343.635301:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:9693:x1874433522290304:12345-192.168.204.30@tcp:101:rm.0 00010000:00010000:3.0:1787599343.635341:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599343.635370:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741182765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07190 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599343.635550:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787599343.636275:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741182765 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07190 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.636296:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:3.0:1787599343.636307:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599343.636315:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741182765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07190 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.636346:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d400, rc 0) 00000100:00100000:3.0:1787599343.637394:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:9693:x1874433522290304:12345-192.168.204.30@tcp:101:rm.0 Request processed in 2087us (3178us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787599343.637407:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:0.0:1787599343.650824:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.651514:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522290432 00000100:00100000:2.0:1787599343.651528:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522290432 00000100:00100000:2.0:1787599343.651607:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:2.0:1787599343.651620:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:9693:x1874433522290432:12345-192.168.204.30@tcp:37:rm.0 00000100:00100000:2.0:1787599343.657280:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:9693:x1874433522290432:12345-192.168.204.30@tcp:37:rm.0 Request processed in 5645us (6452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599343.657316:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:3.0:1787599343.666767:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599343.667282:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522290688 00000100:00100000:0.0:1787599343.667299:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522290688 00000100:00100000:0.0:1787599343.667384:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:0.0:1787599343.667397:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c78850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:9693:x1874433522290688:12345-192.168.204.30@tcp:35:rm.0 00000100:00100000:0.0:1787599343.667803:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c78850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:9693:x1874433522290688:12345-192.168.204.30@tcp:35:rm.0 Request processed in 408us (1050us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787599343.667813:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:0.0:1787599343.673843:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.673959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522290944 00000100:00100000:2.0:1787599343.673973:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522290944 00000100:00100000:2.0:1787599343.674065:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:2.0:1787599343.674079:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:9693:x1874433522290944:12345-192.168.204.30@tcp:101:rm.0 00010000:00010000:2.0:1787599343.674115:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599343.674145:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07197 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.674349:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc674118277a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.674367:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc674118277a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.674383:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc674118277a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599343.674397:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787599343.674625:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07197 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.674664:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc674118277a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07197 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.674674:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:2.0:1787599343.674677:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787599343.674681:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619600, rc 0) 00000100:00100000:2.0:1787599343.674779:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:9693:x1874433522290944:12345-192.168.204.30@tcp:101:rm.0 Request processed in 703us (951us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787599343.674788:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:1.0:1787599343.677829:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.677925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522291072 00000100:00100000:2.0:1787599343.677949:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522291072 00000100:00100000:2.0:1787599343.678033:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:2.0:1787599343.678047:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:9693:x1874433522291072:12345-192.168.204.30@tcp:41:rm.0 00000004:00000024:2.0:1787599343.678137:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787599343.678258:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:9693:x1874433522291072:12345-192.168.204.30@tcp:41:rm.0 Request processed in 213us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599343.678267:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:3.0:1787599343.682767:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.682961:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522291200 00000100:00100000:2.0:1787599343.682975:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522291200 00000100:00100000:2.0:1787599343.683070:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:2.0:1787599343.683086:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:9693:x1874433522291200:12345-192.168.204.30@tcp:101:rm.0 00010000:00010000:2.0:1787599343.683118:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599343.683150:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182788 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0719e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.683393:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc674118278f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.683411:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc674118278f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.683425:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc674118278f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.683443:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.683469:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.683477:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684746:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc674118279d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684763:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc674118279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684775:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc674118279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599343.684826:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787599343.684831:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599343.684857:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc674118279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684872:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc674118279d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684882:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc674118278f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684889:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc674118278f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684897:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc674118278f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684923:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599343.684929:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc674118278f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684938:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc674118278f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684955:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:2.0:1787599343.684958:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599343.684964:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc674118278f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684971:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc674118278f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.684995:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.685003:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182796 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.685009:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.685015:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599343.685019:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.685026:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.685046:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff9f6c70382000) 00010000:00010000:2.0:1787599343.685049:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599343.685062:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182796 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.685068:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.685119:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182788 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0719e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.685136:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc674118279d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0719e expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.685144:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f6c50836300) 00010000:00010000:2.0:1787599343.685146:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599343.685150:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619400, rc 0) 00000100:00100000:2.0:1787599343.686238:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+17:9693:x1874433522291200:12345-192.168.204.30@tcp:101:rm.0 Request processed in 3150us (3482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599343.686251:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:3.0:1787599343.690141:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.694454:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522291456 00000100:00100000:2.0:1787599343.694481:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522291456 00000100:00100000:2.0:1787599343.694596:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:2.0:1787599343.694609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+17:9693:x1874433522291456:12345-192.168.204.30@tcp:36:rm.0 00010000:00010000:2.0:1787599343.694753:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787599343.694790:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc674118279d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0719e expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.694851:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182749 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07182 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.694873:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f6c50836300) 00010000:00010000:2.0:1787599343.694892:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118275e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07189 expref: 15 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.694903:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:2.0:1787599343.694908:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599343.695616:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.695646:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.695658:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.695679:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.695686:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.695692:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.695908:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618200/0xa46cbc67411827b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.695927:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618200/0xa46cbc67411827b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.695946:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618200/0xa46cbc67411827b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599343.697482:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787599343.697504:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301071346693ns, next at 302071343065ns, rc = 0 00010000:00010000:2.0:1787599343.697605:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.697620:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698601:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698619:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698625:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698703:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698803:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599343.698839:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618200/0xa46cbc67411827b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698846:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618200/0xa46cbc67411827b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698869:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618200/0xa46cbc67411827b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698876:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599343.698882:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618200/0xa46cbc67411827b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698891:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618200/0xa46cbc67411827b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698907:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f6c70382e00) 00010000:00010000:2.0:1787599343.698911:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787599343.698917:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618200/0xa46cbc67411827b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.698923:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618200/0xa46cbc67411827b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.699004:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.699011:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.699018:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.699023:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599343.699027:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.699043:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.699063:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:2.0:1787599343.699065:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599343.699069:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.699075:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599343.699089:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052ebabfe reply state 0000000054e85909 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599343.699100:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599343.701231:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:9693:x1874433522291456:12345-192.168.204.30@tcp:36:rm.0 Request processed in 6604us (11087us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787599343.701248:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00010000:00010000:1.0:1787599343.703682:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599343.703701:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.703713:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599343.703718:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.703730:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.703756:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f6c70382e00) 00010000:00010000:1.0:1787599343.703759:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787599343.703765:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.703796:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411827b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.703833:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599343.703836:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599343.703838:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599343.706860:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.706884:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.706893:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.706899:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599343.706906:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.706941:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.706963:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff9f6c70382900) 00010000:00010000:2.0:1787599343.706967:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599343.706973:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.706980:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599343.713495:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.713806:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522291712 00000100:00100000:2.0:1787599343.713820:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522291712 00000100:00100000:2.0:1787599343.713903:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1787599343.713918:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:9693:x1874433522291712:12345-192.168.204.30@tcp:35:rm.0 00000100:00100000:2.0:1787599343.714386:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:9693:x1874433522291712:12345-192.168.204.30@tcp:35:rm.0 Request processed in 468us (904us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787599343.714396:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:1.0:1787599343.719694:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599343.720081:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522291968 00000100:00100000:2.0:1787599343.720095:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522291968 00000100:00100000:2.0:1787599343.720225:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:2.0:1787599343.720240:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:9693:x1874433522291968:12345-192.168.204.30@tcp:36:rm.0 00010000:00010000:2.0:1787599343.720338:0:8189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787599343.720379:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc674118277a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07197 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.720410:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741182718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07174 expref: 15 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.720446:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:2.0:1787599343.720469:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411826d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07166 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.720479:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:2.0:1787599343.720489:0:8189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599343.720530:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.720547:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.720558:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.720573:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.720580:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599343.720587:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.721492:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc67411827ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.721506:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc67411827ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.721516:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc67411827ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599343.722368:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787599343.722392:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc67411827ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722402:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc67411827ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722410:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc67411827ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722429:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599343.722435:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc67411827ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722445:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc67411827ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722461:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f6c70860e00) 00010000:00010000:3.0:1787599343.722465:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787599343.722471:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc67411827ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722478:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc67411827ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722512:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722518:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722525:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722529:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599343.722532:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722538:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722560:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382900) 00010000:00010000:3.0:1787599343.722562:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599343.722566:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599343.722573:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc67411827c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599343.722595:0:8189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d914ade1 reply state 00000000f7d3e7e8 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599343.722607:0:8189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599343.722770:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:9693:x1874433522291968:12345-192.168.204.30@tcp:36:rm.0 Request processed in 2527us (3084us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787599343.722781:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00010000:00010000:1.0:1787599343.726614:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.726648:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.726657:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.726664:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599343.726670:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.726678:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.726700:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f6c70382000) 00010000:00010000:1.0:1787599343.726704:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599343.726710:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599343.726717:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411827c7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599344.622447:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599345.640314:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787599345.701868:0:6729:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303075707303ns, next at 304075703847ns, rc = 0 00000100:00100000:3.0:1787599345.701928:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543295872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599345.702038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599345.702173:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543295872 00000100:00100000:3.0:1787599345.702183:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543295872 00000100:00100000:3.0:1787599345.702262:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787599345.702275:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543295872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599345.702337:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599345.702398:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543295872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599345.702406:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787599345.702431:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787599345.702490:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75b1f100 x1874433543295872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599345.702518:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543295872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599346.311541:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599346.311584:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599346.311622:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599346.311652:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599346.311690:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522292224 00000100:00100000:1.0:1787599346.311704:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522292224 00000100:00100000:2.0:1787599346.313345:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522292480 00000100:00100000:2.0:1787599346.313365:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522292480 00000100:00100000:2.0:1787599346.313465:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 104 00000100:00100000:2.0:1787599346.313478:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522292480:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599346.313604:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522292480:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 128us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599346.313613:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 104 00000100:00100000:1.0:1787599346.315442:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 105 00000100:00100000:1.0:1787599346.315462:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:2357:x1874433522292224:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599346.315587:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:2357:x1874433522292224:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 133us (4062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599346.315596:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 105 00000100:00100000:1.0:1787599346.315635:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522292096 00000100:00100000:1.0:1787599346.315645:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522292096 00000100:00100000:1.0:1787599346.315685:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 252 00000100:00100000:1.0:1787599346.315693:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522292096:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599346.315722:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522292096:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (4098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599346.315729:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 252 00000100:00100000:1.0:1787599346.315767:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522292352 00000100:00100000:1.0:1787599346.315772:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522292352 00000100:00100000:1.0:1787599346.315810:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:1.0:1787599346.315818:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522292352:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599346.315848:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522292352:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 31us (4196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599346.315875:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00080000:1.0:1787599346.315896:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599346.315902:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787599346.665888:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599347.681421:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599347.746081:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543296000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599347.746239:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599347.746376:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543296000 00000100:00100000:2.0:1787599347.746389:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543296000 00000100:00100000:2.0:1787599347.746467:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599347.746478:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543296000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599347.746525:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599347.746611:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543296000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599347.746620:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787599347.747075:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787599347.747136:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75026d80 x1874433543296000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599347.747192:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543296000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599347.752215:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543296128:0@lo:400:kworker.0 00000100:00100000:0.0:1787599347.752326:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599347.752382:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543296640:0@lo:400:kworker.0 00000100:00100000:0.0:1787599347.752411:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599347.752444:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599347.752451:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543296512:0@lo:400:kworker.0 00000100:00100000:0.0:1787599347.752476:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599347.752510:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543296640 00000100:00100000:0.0:1787599347.752518:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543296640 00000100:00100000:0.0:1787599347.752580:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599347.752589:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543296640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599347.752649:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543296640:12345-0@lo:400:kworker.0 Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599347.752656:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599347.752705:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543296640:0@lo:400:kworker.0 00000100:00100000:2.0:1787599347.752880:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543296128 00000100:00100000:2.0:1787599347.752892:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543296128 00000100:00100000:2.0:1787599347.752958:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787599347.752968:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543296128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599347.753059:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543296128:12345-0@lo:400:kworker.0 Request processed in 92us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599347.753066:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787599347.753217:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543296256:0@lo:400:kworker.0 00000100:00100000:3.0:1787599347.753263:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599347.753277:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543296384:0@lo:400:kworker.0 00000100:00100000:3.0:1787599347.753323:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543296512 00000100:00100000:2.0:1787599347.753332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599347.753335:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543296512 00000100:00100000:3.0:1787599347.753377:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787599347.753385:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543296512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599347.753444:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543296512:12345-0@lo:400:kworker.0 Request processed in 58us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599347.753452:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787599347.753482:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543296256 00000100:00100000:3.0:1787599347.753488:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543296256 00000100:00100000:3.0:1787599347.753522:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543296384 00000100:00100000:3.0:1787599347.753525:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543296384 00000100:00100000:3.0:1787599347.753547:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787599347.753554:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543296256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599347.753594:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543296256:12345-0@lo:400:kworker.0 Request processed in 41us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599347.753602:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787599347.753622:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787599347.753630:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543296384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599347.753681:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543296384:12345-0@lo:400:kworker.0 Request processed in 50us (354us total) trans 0 rc 0/0 00010000:00080000:0.0:1787599347.753715:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75027100 x1874433543296512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599347.753745:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543296512:0@lo:400:kworker.0 00000100:00100000:0.0:1787599347.753782:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543296128:0@lo:400:kworker.0 00000100:00080000:1.0:1787599347.753784:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599347.753801:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599347.753879:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543296256:0@lo:400:kworker.0 00000100:00100000:1.0:1787599347.757251:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543296384:0@lo:400:kworker.0 00000100:00100000:3.0:1787599347.765508:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000001:00080000:0.0:1787599348.376868:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:0.0:1787599348.376893:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1787599348.376901:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1787599348.376927:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787599348.376933:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1787599348.377135:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599348.377181:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543296768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787599348.377261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599348.377625:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543296768 00000100:00100000:2.0:1787599348.377634:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543296768 00000100:00100000:2.0:1787599348.377690:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599348.377701:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543296768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787599348.377729:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787599348.377764:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c99ee, atime: 0x6a8c99ee, ctime: 0x6a8c99ee, blocks: 0x1 00010000:00010000:2.0:1787599348.377783:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc67411827d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599348.377799:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=305s v=(0 0) 00010000:00010000:2.0:1787599348.377803:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599348.377810:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc67411827d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599348.377828:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc67411827d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599348.377837:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc67411827d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599348.377844:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc67411827d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599348.377861:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787599348.378658:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874433543296768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 955us (1392us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787599348.378668:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787599348.378695:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599348.378703:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc67411827d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599348.378712:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618e00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599348.378717:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc67411827d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599348.378737:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc67411827d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599348.378757:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc67411827d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599348.378765:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc67411827d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599348.378787:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599348.378788:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599348.378790:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787599348.378914:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c75027480/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787599348.378922:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543296768:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787599348.728740:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787599348.895838:0:11599:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1787599348.901241:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1787599349.729354:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787599350.427034:0:11647:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed15f06f0 20000000:00000080:0.0:1787599350.427062:0:11647:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f6c75f32400 uarg=0000000000000000 20000000:01000000:0.0:1787599350.427334:0:11647:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787599350.427342:0:11647:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787599350.427349:0:11647:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787599350.432531:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787599350.432732:0:11647:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787599350.444333:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787599350.444407:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787599350.444467:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787599350.444490:0:11647:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787599350.444517:0:11647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.444543:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741182677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07151 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.444552:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c751fee00/0xa46cbc674118267e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07158 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.444575:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118268c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182685 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.444581:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c751ff800/0xa46cbc674118269a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741182693 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.444588:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c5b24d000/0xa46cbc67411826a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411826a1 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.445004:0:11647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.445067:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c5b24d000/0xa46cbc67411826a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411826a1 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.445082:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c5b24d000/0xa46cbc67411826a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411826a1 expref: 18 pid: 5825 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599350.445103:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874433543296896:0@lo:104: 00000100:00100000:1.0:1787599350.448984:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599350.449129:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c751ff800/0xa46cbc674118269a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741182693 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.449149:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c751ff800/0xa46cbc674118269a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741182693 expref: 18 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599350.449231:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874433543297024:0@lo:104: 00000100:00100000:1.0:1787599350.449287:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599350.449323:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118268c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741182685 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.449331:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118268c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741182685 expref: 18 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599350.449339:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874433543297152:0@lo:104: 00000100:00100000:1.0:1787599350.449366:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599350.449389:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c751fee00/0xa46cbc674118267e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07158 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.449402:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c751fee00/0xa46cbc674118267e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07158 expref: 12 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599350.449412:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874433543297280:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599350.449614:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787599350.449633:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543296896 00000100:00100000:3.0:1787599350.449642:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543296896 00000100:00100000:3.0:1787599350.449699:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543297024 00000100:00100000:3.0:1787599350.449702:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543297024 00000100:00100000:3.0:1787599350.449715:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543297152 00000100:00100000:3.0:1787599350.449717:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543297152 00000100:00100000:0.0:1787599350.449732:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787599350.449753:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:11647:x1874433543296896:12345-0@lo:104: 00010000:00010000:0.0:1787599350.449771:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.449838:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599350.449845:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+5:11647:x1874433543296896:12345-0@lo:104: Request processed in 98us (873us total) trans 0 rc 0/0 00010000:00010000:1.0:1787599350.450056:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741182677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07151 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.450067:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741182677 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07151 expref: 12 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599350.450079:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874433543297408:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599350.450119:0:11647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599350.450151:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874433543296896:0@lo:104: 00010000:00010000:1.0:1787599350.450220:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599350.450238:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.450246:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24de00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599350.450250:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.450260:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599350.450268:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599350.450274:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599350.450311:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.450317:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599350.450340:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.450347:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc67411826a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411826a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.450363:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599350.450365:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599350.450367:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599350.450382:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543297536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599350.450415:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599350.450468:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543297536 00000100:00100000:1.0:1787599350.450472:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543297536 00010000:00010000:1.0:1787599350.450504:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c5b24d000/0xa46cbc67411826a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411826a1 expref: 19 pid: 5825 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599350.450529:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599350.450537:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543297536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599350.450548:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599350.450554:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c5b24d000/0xa46cbc67411826a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411826a1 expref: 19 pid: 5825 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.450565:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c5b24d000/0xa46cbc67411826a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411826a1 expref: 19 pid: 5825 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.450581:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24d000/0xa46cbc67411826a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411826a1 expref: 19 pid: 5825 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.450610:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599350.450642:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:3302:x1874433543297536:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599350.450649:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599350.450679:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543297536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599350.459125:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599350.459205:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522292608 00000100:00100000:3.0:1787599350.459217:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522292608 00000100:00100000:0.0:1787599350.459522:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787599350.459738:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c751fee00/0xa46cbc674118267e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07158 expref: 13 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599350.459859:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874433543297280:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599350.459943:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:3.0:1787599350.459957:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2359:x1874433522292608:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599350.459982:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599350.459990:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c751fee00/0xa46cbc674118267e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07158 expref: 13 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599350.460003:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c751fee00/0xa46cbc674118267e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07158 expref: 13 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599350.460030:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751fee00/0xa46cbc674118267e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07158 expref: 13 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599350.460049:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599350.460135:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:2359:x1874433522292608:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 181us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599350.461085:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599350.461107:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:11647:x1874433543297024:12345-0@lo:104: 00000100:00100000:2.0:1787599350.461114:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874433543297408:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599350.461130:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.461238:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599350.461245:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+4:11647:x1874433543297024:12345-0@lo:104: Request processed in 148us (11958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599350.461264:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787599350.461277:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874433543297024:0@lo:104: 00010000:00010000:1.0:1787599350.461296:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599350.461303:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.461313:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599350.461318:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.461328:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599350.461336:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599350.461343:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599350.461395:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.461402:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599350.461433:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.461440:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe200/0xa46cbc6741182693 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118269a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599350.461445:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543297664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599350.461456:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599350.461460:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599350.461462:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599350.461474:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599350.461493:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:11647:x1874433543297152:12345-0@lo:104: 00010000:00010000:1.0:1787599350.461503:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599350.461514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599350.461566:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543297664 00000100:00100000:1.0:1787599350.461574:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543297664 00000100:00100000:2.0:1787599350.461609:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874433543297152:0@lo:104: 00010000:00010000:2.0:1787599350.461652:0:11647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.461918:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c751ff800/0xa46cbc674118269a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182693 expref: 18 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599350.465330:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:1.0:1787599350.466390:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787599350.466417:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58443450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:3299:x1874433543297664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599350.466448:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599350.466460:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c751ff800/0xa46cbc674118269a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182693 expref: 18 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.466481:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c751ff800/0xa46cbc674118269a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741182693 expref: 18 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.466503:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751ff800/0xa46cbc674118269a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741182693 expref: 18 pid: 5824 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599350.466523:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599350.467365:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599350.467402:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522292736 00000100:00100000:0.0:1787599350.467413:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522292736 00010000:00010000:0.0:1787599350.467454:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741182677 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07151 expref: 12 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599350.467507:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:0.0:1787599350.467517:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:2358:x1874433522292736:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599350.467531:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599350.467537:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741182677 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07151 expref: 12 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.467548:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741182677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07151 expref: 12 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.467566:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741182677 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07151 expref: 12 pid: 5824 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599350.467663:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599350.467721:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:2358:x1874433522292736:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 205us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599350.467731:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00010000:00010000:0.0:1787599350.468971:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599350.468992:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+3:11647:x1874433543297152:12345-0@lo:104: Request processed in 7496us (19618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599350.469005:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787599350.469188:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599350.469199:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469233:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8600 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:2.0:1787599350.469239:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469252:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599350.469260:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599350.469267:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599350.469321:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469328:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599350.469354:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469361:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c582d8600/0xa46cbc6741182685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc674118268c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469381:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599350.469383:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599350.469386:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599350.469406:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543297792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599350.469506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599350.469543:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58443450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:3299:x1874433543297664:12345-0@lo:103:ldlm_bl.0 Request processed in 3137us (8028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599350.469557:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599350.469627:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543297664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599350.469657:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543297792 00000100:00100000:2.0:1787599350.469671:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543297792 00010000:00010000:2.0:1787599350.469705:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118268c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182685 expref: 17 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599350.469732:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599350.469742:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:3300:x1874433543297792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599350.469757:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599350.469763:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118268c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741182685 expref: 17 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469777:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118268c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741182685 expref: 17 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469793:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118268c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741182685 expref: 17 pid: 5826 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469812:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469822:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469841:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469850:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469860:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469867:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469880:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599350.469886:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469895:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469910:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.469942:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599350.469976:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3300:x1874433543297792:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599350.469984:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599350.470011:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543297792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599350.470038:0:11647:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.470048:0:11647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.470055:0:11647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751fe600/0xa46cbc67411827dc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599350.754927:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599350.818769:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599350.818804:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543297920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599350.818905:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599350.821895:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543297920 00000100:00100000:3.0:1787599350.821924:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543297920 00000100:00080000:1.0:1787599350.822035:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599350.827853:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787599350.827890:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543297920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599350.827958:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599350.829367:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543297920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1487us (10450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599350.829383:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787599350.832819:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787599350.832835:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c75027480, transno 4294967300 00000100:00100000:0.0:1787599350.832972:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543297920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599351.428717:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599351.428767:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599351.428814:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599351.428859:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599351.429123:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522292864 00000100:00100000:3.0:1787599351.429137:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522292864 00000100:00100000:1.0:1787599351.429224:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522292992 00000100:00100000:1.0:1787599351.429232:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522292992 00000100:00100000:3.0:1787599351.429237:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 254 00000100:00100000:3.0:1787599351.429251:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:2359:x1874433522292864:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599351.429287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522293248 00000100:00100000:1.0:1787599351.429292:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522293248 00000100:00100000:1.0:1787599351.429345:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00100000:3.0:1787599351.429359:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:2359:x1874433522292864:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 107us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599351.429359:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522292992:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599351.429376:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 254 00000100:00100000:1.0:1787599351.429411:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522292992:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 58us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599351.429420:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00100000:1.0:1787599351.429438:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 110 00000100:00100000:1.0:1787599351.429445:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2359:x1874433522293248:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599351.429476:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2359:x1874433522293248:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 31us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599351.429484:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 110 00000100:00100000:1.0:1787599351.429507:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522293120 00000100:00100000:1.0:1787599351.429512:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522293120 00000100:00100000:1.0:1787599351.429545:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:1.0:1787599351.429553:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522293120:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599351.429589:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522293120:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 38us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599351.429597:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00080000:3.0:1787599351.429604:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599351.429611:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1787599351.590209:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787599351.590220:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6b4432d000 from 7 10000000:01000000:2.0:1787599351.590227:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599351.590300:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599351.590394:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599351.590408:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599351.590749:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599351.590857:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599351.590967:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599351.591282:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543298048 00000100:00100000:0.0:1787599351.591293:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543298048 00000100:00100000:0.0:1787599351.591376:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787599351.591389:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c5843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:5828:x1874433543298048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599351.591408:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599351.591714:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751ff200/0xa46cbc67411827ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411827e3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599351.591753:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ff200/0xa46cbc67411827ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411827e3 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599351.591766:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751ff200/0xa46cbc67411827ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411827e3 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599351.591778:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff200, rc 0) 00000100:00100000:0.0:1787599351.591858:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c5843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543298048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 471us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.591866:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787599351.592029:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599351.592048:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599351.592059:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599351.592141:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599351.592214:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599351.592255:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599351.592695:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543298176 00000100:00100000:0.0:1787599351.592703:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543298176 00000100:00100000:0.0:1787599351.592749:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787599351.592758:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543298176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599351.593204:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543298176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 445us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.593212:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787599351.593565:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599351.593696:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599351.593754:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599351.593793:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599351.593964:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543298304 00000100:00100000:0.0:1787599351.593970:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543298304 00000100:00100000:0.0:1787599351.594029:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787599351.594040:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543298304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599351.594571:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543298304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 529us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.594589:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787599351.594934:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599351.596805:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11660:1874433543298432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599351.596954:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.597211:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599351.597280:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543298432 00000100:00100000:3.0:1787599351.597291:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543298432 00000100:00100000:3.0:1787599351.597686:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787599351.597702:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:11660:x1874433543298432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599351.598230:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:11660:x1874433543298432:12345-0@lo:502:llog_process_th.0 Request processed in 531us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599351.598251:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787599351.598751:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11660:1874433543298432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599351.598802:0:11660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599351.598815:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599351.598818:0:11660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787599351.598829:0:11660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f6b4432d000 00000020:00000080:0.0:1787599351.598832:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787599351.599031:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11660:1874433543298560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599351.599095:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.599151:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599351.599449:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543298560 00000100:00100000:3.0:1787599351.599458:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543298560 00000100:00100000:0.0:1787599351.599720:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787599351.599733:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:11660:x1874433543298560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599351.600081:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:11660:x1874433543298560:12345-0@lo:502:llog_process_th.0 Request processed in 350us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.600097:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787599351.600228:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11660:1874433543298560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599351.600266:0:11660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599351.600273:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599351.600276:0:11660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787599351.600280:0:11660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787599351.600917:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787599351.600946:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599351.600959:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599351.600983:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599351.600995:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599351.600998:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c50231800 from 7 10000000:01000000:0.0:1787599351.601001:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599351.601040:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599351.601049:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599351.601060:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599351.601083:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599351.601138:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.601210:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599351.601468:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543298688 00000100:00100000:3.0:1787599351.601476:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543298688 00000100:00100000:3.0:1787599351.601532:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787599351.601543:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:5828:x1874433543298688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599351.601559:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599351.601699:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c5b24c000/0xa46cbc67411827f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411827f1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599351.601729:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c5b24c000/0xa46cbc67411827f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411827f1 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599351.601742:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c5b24c000/0xa46cbc67411827f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411827f1 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599351.601753:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c000, rc 0) 00000100:00100000:3.0:1787599351.601805:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543298688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 263us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599351.601812:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787599351.602114:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599351.602133:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599351.602182:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599351.602258:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599351.602295:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599351.602341:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98840 going to sleep for 11 seconds 00000100:00100000:3.0:1787599351.602538:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543298816 00000100:00100000:3.0:1787599351.602544:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543298816 00000100:00100000:3.0:1787599351.602720:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787599351.602732:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46643c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543298816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599351.603089:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46643c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543298816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 360us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599351.603097:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787599351.603209:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599351.603253:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599351.603304:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599351.610112:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543298944 00000100:00100000:1.0:1787599351.610134:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543298944 00000100:00100000:1.0:1787599351.610231:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787599351.610249:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543298944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599351.610570:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643780 going to sleep for 11 seconds 00000100:00100000:1.0:1787599351.611034:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543298944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 787us (7725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599351.611046:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787599351.611813:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543298944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599351.612458:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11663:1874433543299072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599351.612550:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599351.612726:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543299072 00000100:00100000:2.0:1787599351.612735:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543299072 00000100:00100000:2.0:1787599351.612799:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787599351.612810:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:11663:x1874433543299072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599351.613182:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643600 going to sleep for 11 seconds 00000100:00100000:2.0:1787599351.613418:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:11663:x1874433543299072:12345-0@lo:502:llog_process_th.0 Request processed in 609us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599351.613653:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787599351.617508:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11663:1874433543299072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599351.617599:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599351.617618:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599351.617622:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787599351.617634:0:11663:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f6c50231800 00000020:00000080:0.0:1787599351.617637:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787599351.617890:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11663:1874433543299200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599351.618103:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599351.618399:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4d79cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599351.618845:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543299200 00000100:00100000:3.0:1787599351.618857:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543299200 00000100:00100000:3.0:1787599351.618995:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787599351.619008:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:11663:x1874433543299200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599351.619415:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:11663:x1874433543299200:12345-0@lo:502:llog_process_th.0 Request processed in 408us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599351.619426:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787599351.620271:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11663:1874433543299200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787599351.620927:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599351.620940:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599351.620943:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787599351.620951:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787599351.621493:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787599351.621524:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599351.621756:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599351.621773:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599351.621788:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599351.621792:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c6dd51000 from 7 10000000:01000000:3.0:1787599351.621795:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599351.621842:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599351.621851:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599351.621862:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599351.621893:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543299328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599351.622074:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599351.622142:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75614600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599351.622441:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543299328 00000100:00100000:0.0:1787599351.622452:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543299328 00000100:00100000:0.0:1787599351.622510:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787599351.622522:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:5828:x1874433543299328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599351.622796:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599351.622817:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751ff400/0xa46cbc6741182806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411827ff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599351.622851:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ff400/0xa46cbc6741182806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411827ff expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599351.622877:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751ff400/0xa46cbc6741182806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411827ff expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599351.622889:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff400, rc 0) 00000100:00100000:0.0:1787599351.623153:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543299328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 632us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.623196:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787599351.623507:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543299328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599351.623604:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599351.623617:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599351.623778:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543299456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599351.623823:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599351.623863:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75614600 going to sleep for 11 seconds 00000100:00100000:2.0:1787599351.625833:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543299456 00000100:00100000:2.0:1787599351.625853:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543299456 00000100:00100000:2.0:1787599351.625954:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787599351.625969:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543299456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599351.626412:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543299456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (2586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599351.626422:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787599351.627054:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543299456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599351.627129:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543299584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599351.627227:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599351.627266:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75614600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599351.627345:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543299584 00000100:00100000:0.0:1787599351.627353:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543299584 00000100:00100000:0.0:1787599351.627399:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787599351.627410:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543299584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599351.627634:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:5828:x1874433543299584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.627642:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787599351.628011:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:5828:1874433543299584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599351.630748:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11664:1874433543299712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599351.630875:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599351.630991:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75614240 going to sleep for 11 seconds 00000100:00100000:0.0:1787599351.636891:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543299712 00000100:00100000:0.0:1787599351.636928:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543299712 00000100:00100000:0.0:1787599351.637019:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787599351.637033:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:11664:x1874433543299712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599351.637413:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:11664:x1874433543299712:12345-0@lo:502:llog_process_th.0 Request processed in 383us (6538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599351.637423:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787599351.637763:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11664:1874433543299712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599351.637816:0:11664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599351.637828:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599351.637831:0:11664:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787599351.637840:0:11664:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f6c6dd51000 00000020:00000080:3.0:1787599351.637843:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787599351.637980:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11664:1874433543299840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599351.638046:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599351.638082:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543299840 00000100:00100000:3.0:1787599351.638087:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543299840 00000100:00100000:3.0:1787599351.638122:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787599351.638131:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:11664:x1874433543299840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599351.638325:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:11664:x1874433543299840:12345-0@lo:502:llog_process_th.0 Request processed in 193us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599351.638333:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787599351.638381:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75614240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599351.638396:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:11664:1874433543299840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599351.638417:0:11664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599351.638422:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599351.638424:0:11664:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787599351.638968:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787599351.639319:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787599351.639352:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599351.639367:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599351.639380:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599351.643337:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787599351.777786:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599352.001311:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599352.001670:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522293376 00000100:00100000:3.0:1787599352.001692:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522293376 00000100:00100000:3.0:1787599352.001764:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 270 00000100:00100000:3.0:1787599352.001775:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c46641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:5598:x1874433522293376:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599352.001797:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599352.001819:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c5b24d400/0xa46cbc674118280d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071a5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599352.001854:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c5b24d400/0xa46cbc674118280d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071a5 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599352.001866:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c5b24d400/0xa46cbc674118280d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071a5 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599352.001908:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d400, rc 0) 00000100:00100000:3.0:1787599352.001976:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c46641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522293376:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 203us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599352.001984:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 270 00000100:00100000:0.0:1787599352.011956:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599352.012130:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522293504 00000100:00100000:2.0:1787599352.012143:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522293504 00000100:00100000:3.0:1787599352.012471:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 271 00000100:00100000:3.0:1787599352.012489:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522293504:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599352.013111:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522293504:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 625us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599352.013122:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 271 00000100:00100000:0.0:1787599352.037329:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599352.037463:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522293632 00000100:00100000:3.0:1787599352.037480:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522293632 00000100:00100000:3.0:1787599352.037562:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 272 00000100:00100000:3.0:1787599352.037575:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522293632:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599352.037820:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522293632:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 246us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599352.037828:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 272 00000100:00100000:2.0:1787599352.044268:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599352.044662:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522293760 00000100:00100000:1.0:1787599352.044673:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522293760 00000100:00100000:1.0:1787599352.044857:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 273 00000100:00100000:1.0:1787599352.044868:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:9963:x1874433522293760:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599352.045366:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:9963:x1874433522293760:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 498us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599352.045376:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 273 00000100:00100000:0.0:1787599352.072663:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599352.072760:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522293888 00000100:00100000:3.0:1787599352.072779:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522293888 00000100:00100000:3.0:1787599352.072866:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 274 00000100:00100000:3.0:1787599352.072879:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:9963:x1874433522293888:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787599352.073296:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:9963:x1874433522293888:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 418us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599352.073306:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 274 00000100:00100000:2.0:1787599352.087045:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599352.089648:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522294016 00000100:00100000:1.0:1787599352.089664:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522294016 00000100:00100000:1.0:1787599352.089744:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 275 00000100:00100000:1.0:1787599352.089755:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:5598:x1874433522294016:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599352.089788:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599352.089806:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c582d9600/0xa46cbc6741182814 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071ac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599352.089837:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c582d9600/0xa46cbc6741182814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071ac expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599352.089847:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c582d9600/0xa46cbc6741182814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071ac expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599352.089857:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9600, rc 0) 00000100:00100000:1.0:1787599352.089945:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:5598:x1874433522294016:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 191us (2913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599352.089952:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 275 00000100:00100000:0.0:1787599352.095465:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599352.095620:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522294144 00000100:00100000:2.0:1787599352.095639:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522294144 00000100:00100000:2.0:1787599352.095726:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 276 00000100:00100000:2.0:1787599352.095739:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:5598:x1874433522294144:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599352.096437:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:5598:x1874433522294144:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 698us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599352.096448:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 276 00000100:00100000:0.0:1787599352.113123:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599352.113310:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522294272 00000100:00100000:3.0:1787599352.113323:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522294272 00000100:00100000:3.0:1787599352.113386:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 277 00000100:00100000:3.0:1787599352.113399:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:5598:x1874433522294272:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599352.113711:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:5598:x1874433522294272:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 313us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599352.113720:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 277 00000100:00100000:0.0:1787599352.125930:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599352.126062:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522294400 00000100:00100000:2.0:1787599352.126076:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522294400 00000100:00100000:2.0:1787599352.126149:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 278 00000100:00100000:2.0:1787599352.126211:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:9966:x1874433522294400:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599352.126564:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:9966:x1874433522294400:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 356us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599352.126574:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 278 00000100:00100000:1.0:1787599352.145357:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599352.145488:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522294528 00000100:00100000:2.0:1787599352.145502:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522294528 00000100:00100000:2.0:1787599352.145584:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 279 00000100:00100000:2.0:1787599352.145597:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:9966:x1874433522294528:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599352.145983:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:9966:x1874433522294528:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 385us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599352.145992:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 279 00000040:00080000:1.0:1787599352.673943:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599352.801380:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599352.868293:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543300224:0@lo:400:kworker.0 00000100:00100000:0.0:1787599352.868398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599352.868480:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543300736:0@lo:400:kworker.0 00000100:00100000:0.0:1787599352.868539:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599352.868578:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787599352.868584:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543300096:0@lo:400:kworker.0 00000100:00100000:0.0:1787599352.868618:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599352.868637:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543300608:0@lo:400:kworker.0 00000100:00100000:0.0:1787599352.868658:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599352.868697:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543300224 00000100:00100000:0.0:1787599352.868707:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543300224 00000100:00100000:0.0:1787599352.868757:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543300608 00000100:00100000:0.0:1787599352.868760:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543300608 00000100:00100000:0.0:1787599352.868789:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787599352.868798:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543300224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599352.868861:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543300224:12345-0@lo:400:kworker.0 Request processed in 62us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599352.868868:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787599352.868907:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787599352.868914:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543300608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599352.868940:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543300608:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599352.868947:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787599352.868991:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543300608:0@lo:400:kworker.0 00000100:00100000:0.0:1787599352.869018:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543300224:0@lo:400:kworker.0 00000100:00100000:2.0:1787599352.869294:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543300736 00000100:00100000:2.0:1787599352.869310:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543300736 00000100:00100000:2.0:1787599352.869361:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787599352.869369:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543300736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599352.869414:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543299968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599352.869422:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543300736:12345-0@lo:400:kworker.0 Request processed in 52us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599352.869430:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787599352.869462:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599352.869472:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543300096 00000100:00100000:2.0:1787599352.869477:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543300096 00000100:00100000:1.0:1787599352.869501:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543300480:0@lo:400:kworker.0 00000100:00100000:2.0:1787599352.869512:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787599352.869522:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543300096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599352.869532:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599352.869560:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599352.869566:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543300096:12345-0@lo:400:kworker.0 Request processed in 46us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599352.869569:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543300352:0@lo:400:kworker.0 00000100:00100000:2.0:1787599352.869580:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787599352.869606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599352.869646:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543300480 00000100:00100000:2.0:1787599352.869650:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543299968 00000100:00100000:1.0:1787599352.869651:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543300480 00000100:00100000:2.0:1787599352.869656:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543299968 00000100:00100000:2.0:1787599352.869685:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787599352.869694:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543299968:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599352.869697:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787599352.869710:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543300480:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787599352.869740:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599352.869763:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543300480:12345-0@lo:400:kworker.0 Request processed in 55us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599352.869771:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787599352.869787:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543299968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599352.869795:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787599352.869813:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75024e00 x1874433543299968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599352.869820:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543300352 00000100:00100000:2.0:1787599352.869825:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543300352 00000100:00100000:1.0:1787599352.869849:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543299968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599352.869855:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787599352.869864:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543300352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599352.869869:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543300480:0@lo:400:kworker.0 00000100:00100000:2.0:1787599352.869920:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543300352:12345-0@lo:400:kworker.0 Request processed in 56us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599352.869928:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787599352.869939:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543300352:0@lo:400:kworker.0 00000100:00080000:3.0:1787599352.870122:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599352.870128:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599352.870131:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599352.871927:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543300096:0@lo:400:kworker.0 00010000:00080000:0.0:1787599352.871957:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c74f87b80 x1874433543300736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599352.871972:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543300736:0@lo:400:kworker.0 00010000:00010000:1.0:1787599353.825462:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599354.849394:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599355.873441:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599355.942212:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599355.942414:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543300864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599355.942912:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599355.943208:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543300864 00000100:00100000:3.0:1787599355.943234:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543300864 00000100:00100000:3.0:1787599355.943355:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787599355.943371:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543300864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599355.943430:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599355.943544:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543300864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599355.943579:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787599355.944035:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599355.945307:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543300864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599356.546959:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599356.547004:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599356.547148:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522294656 00000100:00100000:3.0:1787599356.547197:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522294656 00000100:00100000:3.0:1787599356.547278:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 281 00000100:00100000:3.0:1787599356.547290:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522294656:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599356.547373:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522294656:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 85us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599356.547381:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 281 00000100:00100000:0.0:1787599356.555304:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599356.555465:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599356.555587:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522294784 00000100:00100000:2.0:1787599356.555605:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522294784 00000100:00100000:3.0:1787599356.555914:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522295040 00000100:00100000:3.0:1787599356.555926:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522295040 00000100:00100000:2.0:1787599356.557249:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 114 00000100:00100000:2.0:1787599356.557271:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522294784:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599356.557537:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522294784:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 274us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599356.557545:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 114 00000100:00100000:1.0:1787599356.558480:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522294912 00000100:00100000:1.0:1787599356.558498:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522294912 00000100:00080000:0.0:1787599356.560952:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599356.560968:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599356.571907:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:3.0:1787599356.571923:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522295040:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599356.572035:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522295040:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 114us (16568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599356.572042:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:1.0:1787599356.582134:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:1.0:1787599356.582190:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522294912:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599356.582313:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522294912:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 164us (35306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599356.582322:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00010000:00010000:2.0:1787599356.897364:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599357.924022:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599357.985725:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599357.985751:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543300992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599357.985840:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599357.986215:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543300992 00000100:00100000:2.0:1787599357.986225:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543300992 00000100:00100000:2.0:1787599357.986306:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787599357.986335:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543300992:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787599357.986364:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787599357.986384:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599357.986440:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543300992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599357.986448:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787599357.986665:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543301504:0@lo:400:kworker.0 00000100:00100000:1.0:1787599357.986712:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599357.986757:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599357.986769:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543301376:0@lo:400:kworker.0 00010000:00080000:3.0:1787599357.986818:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75024e00 x1874433543300992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599357.986836:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599357.986864:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543300992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599357.987247:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543301248:0@lo:400:kworker.0 00000100:00100000:0.0:1787599357.987312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599357.987367:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787599357.987374:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543301120:0@lo:400:kworker.0 00000100:00100000:0.0:1787599357.987930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599357.988043:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543301632:0@lo:400:kworker.0 00000100:00100000:0.0:1787599357.988076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599357.988118:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543301504 00000100:00100000:0.0:1787599357.988126:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543301504 00000100:00100000:0.0:1787599357.989038:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787599357.989056:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543301504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599357.989145:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543301504:12345-0@lo:400:kworker.0 Request processed in 96us (2433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599357.989197:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1787599357.989230:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599357.989363:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543301376 00000100:00100000:3.0:1787599357.989370:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543301376 00000100:00100000:3.0:1787599357.989415:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543301248 00000100:00100000:3.0:1787599357.989419:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543301248 00000100:00100000:3.0:1787599357.989430:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543301632 00000100:00100000:3.0:1787599357.989433:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543301632 00000100:00100000:3.0:1787599357.989447:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787599357.989454:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543301376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599357.989495:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543301376:12345-0@lo:400:kworker.0 Request processed in 42us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599357.989501:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787599357.989514:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787599357.989520:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543301248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599357.989550:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543301248:12345-0@lo:400:kworker.0 Request processed in 31us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599357.989566:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787599357.989577:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787599357.989583:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543301632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599357.989612:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543301632:12345-0@lo:400:kworker.0 Request processed in 30us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599357.989618:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787599357.989994:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543301120 00000100:00100000:1.0:1787599357.990007:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543301120 00000100:00100000:1.0:1787599357.990048:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787599357.990055:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543301120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599357.990114:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543301120:12345-0@lo:400:kworker.0 Request processed in 60us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599357.990121:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787599357.990214:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543301376:0@lo:400:kworker.0 00000100:00100000:1.0:1787599357.990229:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543301504:0@lo:400:kworker.0 00000100:00080000:0.0:1787599357.991248:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599357.991296:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543301120:0@lo:400:kworker.0 00000100:00100000:0.0:1787599357.991314:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543301632:0@lo:400:kworker.0 00000100:00100000:0.0:1787599357.991326:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543301248:0@lo:400:kworker.0 00010000:00010000:2.0:1787599358.945294:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599359.974148:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599360.993500:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599361.062115:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543301760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599361.062229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599361.062324:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543301760 00000100:00100000:0.0:1787599361.062334:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543301760 00000100:00100000:0.0:1787599361.062414:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787599361.062425:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543301760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599361.062916:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599361.062984:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543301760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 559us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599361.062993:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787599361.063023:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599361.063075:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543301760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599361.664961:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599361.665018:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599361.665048:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599361.665088:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599361.665122:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522295424 00000100:00100000:2.0:1787599361.665133:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522295424 00000100:00100000:1.0:1787599361.665140:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522295296 00000100:00100000:1.0:1787599361.665143:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522295296 00000100:00100000:3.0:1787599361.665216:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522295552 00000100:00100000:3.0:1787599361.665221:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522295552 00000100:00100000:2.0:1787599361.665318:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:2.0:1787599361.665328:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2356:x1874433522295424:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599361.665401:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2356:x1874433522295424:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 75us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599361.665421:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:0.0:1787599361.665784:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522295168 00000100:00100000:0.0:1787599361.665789:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522295168 00000100:00100000:0.0:1787599361.665829:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 283 00000100:00100000:0.0:1787599361.665836:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522295168:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599361.665874:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522295168:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 38us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599361.665890:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 283 00000100:00100000:1.0:1787599361.666669:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:1.0:1787599361.666681:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522295296:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599361.666744:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522295296:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 66us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599361.666751:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:3.0:1787599361.669673:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:3.0:1787599361.669690:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522295552:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599361.669778:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522295552:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 93us (4728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599361.669786:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00080000:0.0:1787599361.670296:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599361.670302:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787599362.018278:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787599362.913955:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599363.041498:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599363.108736:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543302144:0@lo:400:kworker.0 00000100:00100000:3.0:1787599363.108840:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599363.108907:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599363.108914:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543302272:0@lo:400:kworker.0 00000100:00100000:3.0:1787599363.108941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599363.108980:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543302144 00000100:00100000:3.0:1787599363.108987:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543302144 00000100:00100000:3.0:1787599363.109041:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787599363.109052:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543302144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599363.109106:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543302144:12345-0@lo:400:kworker.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599363.109113:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787599363.109420:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543302016:0@lo:400:kworker.0 00000100:00100000:1.0:1787599363.109451:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599363.109473:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543302528:0@lo:400:kworker.0 00000100:00100000:1.0:1787599363.109497:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599363.109513:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543301888:0@lo:400:kworker.0 00000100:00100000:1.0:1787599363.109531:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543302272 00000100:00100000:1.0:1787599363.109535:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543302272 00000100:00100000:0.0:1787599363.109546:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599363.109559:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543302528 00000100:00100000:1.0:1787599363.109561:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543302528 00000100:00100000:0.0:1787599363.109571:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543302400:0@lo:400:kworker.0 00000100:00100000:1.0:1787599363.109588:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787599363.109591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599363.109595:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543302272:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787599363.109620:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599363.109623:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599363.109626:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543302272:12345-0@lo:400:kworker.0 Request processed in 33us (685us total) trans 0 rc 0/0 00000100:00080000:0.0:1787599363.109637:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599363.109648:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543301888 00000100:00100000:0.0:1787599363.109652:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543301888 00000100:00100000:1.0:1787599363.109712:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787599363.110728:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543302016 00000100:00100000:2.0:1787599363.110734:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543302016 00000100:00100000:2.0:1787599363.110766:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543302400 00000100:00100000:2.0:1787599363.110769:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543302400 00000100:00100000:0.0:1787599363.112621:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787599363.114390:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543301888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599363.114499:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543301888:12345-0@lo:400:kworker.0 Request processed in 132us (4951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599363.114508:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787599363.114564:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599363.114583:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543302656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599363.114620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599363.114773:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543302656 00000100:00100000:0.0:1787599363.114782:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543302656 00000100:00100000:0.0:1787599363.114820:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787599363.114827:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874433543302656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599363.114855:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599363.114890:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874433543302656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599363.114912:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787599363.114953:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fa0c700 x1874433543302656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599363.114977:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543302656:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787599363.115000:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599363.115336:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599363.115352:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543302528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599363.115402:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543302528:12345-0@lo:400:kworker.0 Request processed in 57us (5904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599363.115409:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787599363.115453:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75e4df80 x1874433543302528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599363.115463:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543302528:0@lo:400:kworker.0 00000100:00100000:3.0:1787599363.116878:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543302144:0@lo:400:kworker.0 00000100:00100000:3.0:1787599363.116926:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543302272:0@lo:400:kworker.0 00000100:00100000:2.0:1787599363.117036:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787599363.117057:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543302016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599363.117143:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543302016:12345-0@lo:400:kworker.0 Request processed in 96us (7691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599363.117439:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787599363.117453:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543302400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599363.117497:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543302400:12345-0@lo:400:kworker.0 Request processed in 50us (7904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599363.117504:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787599363.117548:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543301888:0@lo:400:kworker.0 00000100:00100000:0.0:1787599363.117562:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543302400:0@lo:400:kworker.0 00000100:00100000:0.0:1787599363.117619:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543302016:0@lo:400:kworker.0 00000100:00100000:2.0:1787599363.121915:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00010000:1.0:1787599364.065793:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599365.092334:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599366.114677:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599366.177857:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599366.177888:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543302784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599366.177994:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599366.178184:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543302784 00000100:00100000:0.0:1787599366.178193:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543302784 00000100:00100000:0.0:1787599366.178282:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787599366.178295:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543302784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599366.178336:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599366.178402:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543302784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599366.178410:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787599366.178474:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599366.178882:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543302784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599366.790339:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599366.790397:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599366.790497:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522295808 00000100:00100000:0.0:1787599366.790507:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522295808 00000100:00100000:0.0:1787599366.790597:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:0.0:1787599366.790635:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2356:x1874433522295808:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599366.790719:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2356:x1874433522295808:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 87us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599366.790727:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00080000:2.0:1787599366.790946:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599366.791024:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522295680 00000100:00100000:1.0:1787599366.791029:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522295680 00000100:00100000:1.0:1787599366.791084:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 285 00000100:00100000:1.0:1787599366.791093:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522295680:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599366.791152:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522295680:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 62us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599366.791192:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 285 00000100:00100000:2.0:1787599366.803945:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599366.804001:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599366.804115:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522296064 00000100:00100000:3.0:1787599366.804132:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522296064 00000100:00100000:3.0:1787599366.804287:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:3.0:1787599366.804300:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522296064:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599366.804430:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522296064:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 132us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599366.804439:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:1.0:1787599366.804635:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522295936 00000100:00100000:1.0:1787599366.804648:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522295936 00000100:00100000:1.0:1787599366.804738:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:1.0:1787599366.804770:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2355:x1874433522295936:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:1.0:1787599366.804804:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182750 00000100:00080000:1.0:1787599366.804815:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9f6b44364800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787599366.804867:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1787599366.804923:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599366.805126:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599366.805133:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599366.805867:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+2:2355:x1874433522295936:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 1100us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599366.805878:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00010000:00010000:1.0:1787599367.139813:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599368.161464:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599368.225686:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543302912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599368.225784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599368.226240:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543302912 00000100:00100000:2.0:1787599368.226250:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543302912 00000100:00100000:2.0:1787599368.226319:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787599368.226331:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543302912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599368.226367:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599368.226416:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543302912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599368.226438:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787599368.226518:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787599368.226549:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c4fa0c700 x1874433543302912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599368.226569:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543302912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599368.227283:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543303040:0@lo:400:kworker.0 00000100:00100000:0.0:1787599368.227337:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599368.227471:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543303040 00000100:00100000:2.0:1787599368.227477:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543303040 00000100:00100000:2.0:1787599368.227525:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787599368.227534:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543303040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599368.227796:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543303296:0@lo:400:kworker.0 00000100:00100000:3.0:1787599368.227831:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599368.227869:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599368.227875:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543303168:0@lo:400:kworker.0 00000100:00100000:3.0:1787599368.227897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599368.227935:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543303296 00000100:00100000:3.0:1787599368.227940:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543303296 00000100:00100000:3.0:1787599368.227973:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543303168 00000100:00100000:3.0:1787599368.227976:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543303168 00000100:00100000:3.0:1787599368.227998:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787599368.228004:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543303296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599368.228043:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543303296:12345-0@lo:400:kworker.0 Request processed in 39us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599368.228050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787599368.228074:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787599368.228080:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543303168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599368.228111:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543303168:12345-0@lo:400:kworker.0 Request processed in 31us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599368.228117:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787599368.228150:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543303168:0@lo:400:kworker.0 00000100:00100000:3.0:1787599368.228187:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543303296:0@lo:400:kworker.0 00000100:00100000:3.0:1787599368.228210:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543303424:0@lo:400:kworker.0 00000100:00100000:3.0:1787599368.228236:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599368.228285:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543303424 00000100:00100000:3.0:1787599368.228289:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543303424 00000100:00100000:3.0:1787599368.228318:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787599368.228326:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543303424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599368.228360:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543303424:12345-0@lo:400:kworker.0 Request processed in 35us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599368.228365:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787599368.228406:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543303424:0@lo:400:kworker.0 00000100:00080000:3.0:1787599368.228433:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599368.228437:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599368.229286:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599368.229298:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543303552:0@lo:400:kworker.0 00000100:00100000:3.0:1787599368.229333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599368.229409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543303552 00000100:00100000:1.0:1787599368.229414:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543303552 00000100:00100000:1.0:1787599368.229464:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787599368.229472:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543303552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599368.229525:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543303552:12345-0@lo:400:kworker.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599368.229532:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787599368.229568:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543303552:0@lo:400:kworker.0 00000100:00080000:3.0:1787599368.229685:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599368.230134:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543303040:12345-0@lo:400:kworker.0 Request processed in 2600us (2795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599368.230144:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787599368.230278:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543303040:0@lo:400:kworker.0 00010000:00010000:1.0:1787599369.188993:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787599369.367756:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:3.0:1787599369.367768:0:6704:0:(genops.c:885:class_export_put()) final put ffff9f6b44a78800/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:0.0:1787599369.368108:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b44a78800/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 for lustre-OST0000 00000020:00000080:2.0:1787599369.368742:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6b44364800 for lustre-OST0000 00010000:00010000:0.0:1787599370.209418:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599371.234276:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599371.302602:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543303680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599371.302677:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599371.304421:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543303680 00000100:00100000:2.0:1787599371.304437:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543303680 00000100:00100000:2.0:1787599371.304603:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787599371.304615:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543303680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599371.304656:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787599371.305039:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599371.307453:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543303680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2830us (4764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599371.307471:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787599371.308008:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543303680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599371.906412:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599371.907497:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599371.907560:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599371.907632:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522296448 00000100:00100000:0.0:1787599371.907643:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522296448 00000100:00100000:0.0:1787599371.907708:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522296320 00000100:00100000:0.0:1787599371.907711:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522296320 00000100:00100000:0.0:1787599371.907735:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:0.0:1787599371.907745:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522296448:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599371.907825:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522296448:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 71us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599371.907833:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:0.0:1787599371.907850:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:0.0:1787599371.907864:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522296320:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599371.907898:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522296320:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 35us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599371.907905:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00080000:2.0:1787599371.908044:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599371.911230:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522296192 00000100:00100000:1.0:1787599371.911246:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522296192 00000100:00100000:1.0:1787599371.911392:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 287 00000100:00100000:1.0:1787599371.911405:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522296192:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599371.911486:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522296192:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 83us (5085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599371.911492:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 287 00000040:00080000:0.0:1787599372.136657:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787599372.258290:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599373.283778:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599373.353590:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599373.353619:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543303808:0@lo:400:kworker.0 00000100:00100000:1.0:1787599373.353677:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543304320:0@lo:400:kworker.0 00000100:00100000:0.0:1787599373.353713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599373.353729:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599373.353775:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543304192:0@lo:400:kworker.0 00000100:00100000:1.0:1787599373.353789:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543303936:0@lo:400:kworker.0 00000100:00100000:0.0:1787599373.353809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599373.353829:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599373.353852:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543303808 00000100:00100000:1.0:1787599373.353857:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543304448:0@lo:400:kworker.0 00000100:00100000:0.0:1787599373.353861:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543303808 00000100:00100000:1.0:1787599373.353889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599373.353915:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599373.353916:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787599373.353925:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543304064:0@lo:400:kworker.0 00000100:00100000:0.0:1787599373.353929:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543303808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599373.353955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599373.353991:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543303808:12345-0@lo:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599373.353994:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543304320 00000100:00100000:1.0:1787599373.353999:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543304320 00000100:00100000:0.0:1787599373.354001:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787599373.354046:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543303936 00000100:00100000:0.0:1787599373.354046:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543304064 00000100:00100000:1.0:1787599373.354050:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543303936 00000100:00100000:0.0:1787599373.354053:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543304064 00000100:00100000:1.0:1787599373.354069:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787599373.354081:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543304320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599373.354106:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787599373.354114:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543303936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599373.354128:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543304320:12345-0@lo:400:kworker.0 Request processed in 50us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599373.354136:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787599373.354178:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543303936:12345-0@lo:400:kworker.0 Request processed in 64us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599373.354181:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787599373.354191:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787599373.354196:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543304064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599373.354230:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543303808:0@lo:400:kworker.0 00000100:00100000:1.0:1787599373.354246:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543304064:12345-0@lo:400:kworker.0 Request processed in 55us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599373.354254:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787599373.354277:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543304192 00000100:00100000:1.0:1787599373.354281:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543304192 00000100:00100000:1.0:1787599373.354320:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543304448 00000100:00100000:1.0:1787599373.354333:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543304448 00000100:00100000:1.0:1787599373.354352:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787599373.354359:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543304192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599373.354400:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787599373.354401:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543304192:12345-0@lo:400:kworker.0 Request processed in 42us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599373.354411:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787599373.354413:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787599373.354430:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787599373.354437:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543304448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599373.354465:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543304448:12345-0@lo:400:kworker.0 Request processed in 29us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599373.354471:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787599373.354504:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599373.354508:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599373.354511:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599373.354534:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543304320:0@lo:400:kworker.0 00000100:00100000:1.0:1787599373.354557:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543304064:0@lo:400:kworker.0 00000100:00100000:1.0:1787599373.354568:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543303936:0@lo:400:kworker.0 00010000:00080000:1.0:1787599373.354579:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75e4e680 x1874433543304448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599373.354603:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543304448:0@lo:400:kworker.0 00000100:00100000:1.0:1787599373.354633:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543304192:0@lo:400:kworker.0 00000100:00100000:1.0:1787599373.354790:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543304576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599373.354822:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599373.354862:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543304576 00000100:00100000:1.0:1787599373.354866:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543304576 00000100:00100000:1.0:1787599373.354891:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599373.354898:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543304576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599373.354929:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599373.354968:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543304576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599373.354974:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787599373.354999:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c7605f800 x1874433543304576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599373.355015:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543304576:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787599374.305826:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787599375.131052:0:11828:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:22:52 (1787599372) 00010000:00010000:2.0:1787599375.331280:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599376.353688:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599376.417912:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599376.417945:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543304704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599376.418059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599376.418631:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543304704 00000100:00100000:1.0:1787599376.418643:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543304704 00000100:00100000:1.0:1787599376.418738:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599376.418751:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543304704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599376.418800:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599376.418874:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543304704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599376.418882:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599376.419209:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543304704:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787599376.421095:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599376.890313:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599376.895888:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522296576 00000100:00100000:0.0:1787599376.895914:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522296576 00000100:00100000:0.0:1787599376.896035:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:0.0:1787599376.896053:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:10240:x1874433522296576:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599376.896082:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599376.896115:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc674118281b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599376.897427:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182822 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599376.897456:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599376.897475:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787599376.897501:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787599376.898683:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787599376.898691:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599376.898845:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599376.899254:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc674118281b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071b3 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599376.899400:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182822 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071b3 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599376.899422:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:0.0:1787599376.899426:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599376.899430:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe800, rc 0) 00000100:00100000:0.0:1787599376.899543:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:10240:x1874433522296576:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 3494us (9245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599376.899563:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:2.0:1787599376.922308:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599376.922383:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522296704 00000100:00100000:1.0:1787599376.922397:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522296704 00000100:00100000:1.0:1787599376.922501:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:1.0:1787599376.922515:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:10241:x1874433522296704:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599376.922543:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599376.922571:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071ba expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.922657:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc6741182830 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.922676:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc6741182830 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.922689:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc6741182830 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.922709:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182837 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.922716:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.922724:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.923683:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8e00/0xa46cbc674118283e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.923703:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8e00/0xa46cbc674118283e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.923723:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8e00/0xa46cbc674118283e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599376.923828:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787599376.923834:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599376.923939:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8e00/0xa46cbc674118283e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.923956:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc6741182830 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.923963:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc6741182830 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.923971:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc6741182830 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.923978:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599376.923984:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc6741182830 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.923994:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc6741182830 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924011:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:1.0:1787599376.924014:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599376.924020:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc6741182830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924027:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc6741182830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924055:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924061:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182837 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924066:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182837 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924072:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599376.924075:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182837 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924082:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182837 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924091:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f6c50836200) 00010000:00010000:1.0:1787599376.924093:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599376.924096:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182837 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924102:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182837 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924151:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071ba expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.924238:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8e00/0xa46cbc674118283e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071ba expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.925393:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f6c50836d00) 00010000:00010000:1.0:1787599376.925397:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599376.925401:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8e00, rc 0) 00000100:00100000:1.0:1787599376.925577:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:10241:x1874433522296704:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 3063us (3283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599376.925588:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:3.0:1787599376.933745:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599376.933817:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522296960 00000100:00100000:1.0:1787599376.933832:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522296960 00000100:00100000:1.0:1787599376.933914:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:1.0:1787599376.933927:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:10241:x1874433522296960:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599376.933956:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599376.933987:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182845 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071c1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.934085:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118284c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.934103:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118284c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.934115:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118284c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.935081:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182853 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.935106:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182853 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.935137:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182853 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.937300:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc674118285a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.937535:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc674118285a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.937550:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc674118285a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599376.937636:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787599376.937933:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118284c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938232:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118284c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938242:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118284c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938248:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599376.938252:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118284c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938260:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118284c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938276:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f6c50836d00) 00010000:00010000:1.0:1787599376.938280:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599376.938294:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118284c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938300:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118284c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938315:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182853 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938334:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182853 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938341:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182853 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938347:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599376.938350:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182853 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938357:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182853 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938366:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f6c50836200) 00010000:00010000:1.0:1787599376.938369:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599376.938372:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182853 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.938379:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182853 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.939106:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182845 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071c1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.939141:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc674118285a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071c1 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599376.939149:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:1.0:1787599376.939152:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599376.939203:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8000, rc 0) 00000100:00100000:1.0:1787599376.939285:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:10241:x1874433522296960:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 5360us (5554us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787599376.939295:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:2.0:1787599376.958153:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599376.958927:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522297088 00000100:00100000:1.0:1787599376.958940:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522297088 00000100:00100000:1.0:1787599376.959034:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:1.0:1787599376.959048:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:10241:x1874433522297088:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787599376.959252:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:10241:x1874433522297088:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 206us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599376.959262:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:2.0:1787599377.027791:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599377.027853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599377.027968:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522297344 00000100:00100000:0.0:1787599377.027981:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522297344 00000100:00100000:0.0:1787599377.028083:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:0.0:1787599377.028097:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2359:x1874433522297344:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599377.028253:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2359:x1874433522297344:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 158us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599377.028261:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00080000:2.0:1787599377.028497:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599377.028586:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522297216 00000100:00100000:1.0:1787599377.028592:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522297216 00000100:00100000:1.0:1787599377.028636:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 289 00000100:00100000:1.0:1787599377.028645:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2359:x1874433522297216:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599377.028680:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2359:x1874433522297216:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 37us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599377.028687:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 289 00000040:00080000:0.0:1787599377.249877:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599377.378252:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599378.407886:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599378.465305:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599378.465335:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543304832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599378.465418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599378.465495:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543304832 00000100:00100000:1.0:1787599378.465503:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543304832 00000100:00100000:1.0:1787599378.465558:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787599378.465567:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543304832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599378.465602:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599378.465793:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543304960:0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.465825:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599378.465850:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543305472:0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.465873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599378.465889:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599378.465894:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543305088:0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.465914:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599378.465946:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543304960 00000100:00100000:0.0:1787599378.465950:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543304960 00000100:00100000:0.0:1787599378.465982:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787599378.465989:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543304960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466027:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543304960:12345-0@lo:400:kworker.0 Request processed in 38us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599378.466033:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787599378.466063:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543305472 00000100:00100000:0.0:1787599378.466066:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543305472 00000100:00100000:0.0:1787599378.466090:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543305088 00000100:00100000:0.0:1787599378.466093:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543305088 00000100:00100000:0.0:1787599378.466114:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787599378.466120:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543305472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466147:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543305472:12345-0@lo:400:kworker.0 Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599378.466152:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787599378.466194:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787599378.466200:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543305088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466227:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543305088:12345-0@lo:400:kworker.0 Request processed in 28us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599378.466233:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787599378.466274:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543305088:0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466284:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543304960:0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466294:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543305472:0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466452:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543305216:0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466486:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599378.466505:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599378.466510:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543305344:0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466530:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599378.466551:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543305216 00000100:00100000:0.0:1787599378.466555:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543305216 00000100:00100000:0.0:1787599378.466580:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787599378.466586:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543305216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466618:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543305216:12345-0@lo:400:kworker.0 Request processed in 32us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599378.466623:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787599378.466779:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543305344 00000100:00100000:0.0:1787599378.466784:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543305344 00000100:00100000:0.0:1787599378.466812:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787599378.466819:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543305344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466850:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543305344:12345-0@lo:400:kworker.0 Request processed in 33us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599378.466856:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787599378.466885:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543305344:0@lo:400:kworker.0 00000100:00100000:0.0:1787599378.466895:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543305216:0@lo:400:kworker.0 00000100:00100000:1.0:1787599378.467007:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543304832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1440us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599378.467014:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787599378.467035:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599378.467040:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599378.467042:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787599378.467296:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c6f27f480 x1874433543304832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599378.467314:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543304832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599378.940190:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599378.940457:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522297472 00000100:00100000:0.0:1787599378.940468:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522297472 00000100:00100000:0.0:1787599378.940582:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:0.0:1787599378.940594:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:10283:x1874433522297472:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599378.940625:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599378.940647:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071c8 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.940715:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc674118286f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.940728:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc674118286f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.940743:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc674118286f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.940758:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182876 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.940765:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.940772:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941032:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc674118286f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941041:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc674118286f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941048:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc674118286f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941064:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599378.941089:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc674118286f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941098:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc674118286f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941112:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:0.0:1787599378.941115:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599378.941120:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc674118286f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941126:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc674118286f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941140:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941145:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182876 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941151:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941241:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ffa00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599378.941245:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941251:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182876 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941270:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599378.941272:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599378.941275:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182876 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941281:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182876 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941360:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182868 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071c8 expref: 10 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941394:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:0.0:1787599378.941397:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599378.941402:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071c8 expref: 10 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.941411:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe400, rc 0) 00000100:00080000:3.0:1787599378.941825:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599378.946938:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:10283:x1874433522297472:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 6336us (6775us total) trans 0 rc 301/301 00000100:00100000:0.0:1787599378.946951:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:3.0:1787599378.960618:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599378.960722:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522297728 00000100:00100000:0.0:1787599378.960738:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522297728 00000100:00100000:0.0:1787599378.960810:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:0.0:1787599378.960821:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:10283:x1874433522297728:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:0.0:1787599378.960878:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599378.960907:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182822 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071b3 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.960939:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:0.0:1787599378.960952:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599378.961351:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc674118287d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.961366:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc674118287d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.961386:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc674118287d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.961400:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.961406:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.961411:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599378.963921:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787599378.963942:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc674118287d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.963953:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc674118287d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.963960:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc674118287d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.963966:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599378.963978:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc674118287d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.963985:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc674118287d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.964002:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599378.964005:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599378.964010:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc674118287d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599378.964017:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc674118287d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599378.964035:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da067dc1 reply state 00000000ccebfc68 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599378.964046:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599378.964369:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:10283:x1874433522297728:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 3545us (3765us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787599378.964395:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00010000:00010000:3.0:1787599378.972849:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599378.972869:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599378.972879:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599378.972886:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ffa00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599378.972891:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599378.972900:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599378.972917:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f6c43a07000) 00010000:00010000:3.0:1787599378.972920:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599378.972926:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599378.972931:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182884 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599379.077185:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599379.079067:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522297856 00000100:00100000:2.0:1787599379.079082:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522297856 00000100:00100000:2.0:1787599379.079147:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:2.0:1787599379.079187:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:10291:x1874433522297856:12345-192.168.204.30@tcp:101:lctl.0 00010000:00010000:2.0:1787599379.079212:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599379.079235:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118288b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071cf expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.079299:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182892 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.079313:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.079324:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599379.080279:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787599379.080285:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599379.080414:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.080453:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118288b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071cf expref: 11 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.080540:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182892 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071cf expref: 10 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.080550:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:2.0:1787599379.080552:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599379.080556:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619600, rc 0) 00000100:00100000:2.0:1787599379.082483:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:10291:x1874433522297856:12345-192.168.204.30@tcp:101:lctl.0 Request processed in 3304us (5283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599379.082496:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00000001:00080000:3.0:1787599379.087280:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:2.0:1787599379.158976:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599379.159102:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522297984 00000100:00100000:3.0:1787599379.159120:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522297984 00000100:00100000:3.0:1787599379.159279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:3.0:1787599379.159312:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:10297:x1874433522297984:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1787599379.159349:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599379.159387:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182899 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.159488:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411828a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.159507:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411828a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.159521:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411828a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.159551:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411828a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.159559:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411828a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.159566:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411828a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160108:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc67411828ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160118:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc67411828ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160126:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc67411828ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599379.160285:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787599379.160290:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599379.160411:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc67411828ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160428:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411828a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160435:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411828a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160443:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411828a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160449:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599379.160455:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411828a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160463:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411828a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160479:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:3.0:1787599379.160482:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599379.160487:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411828a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160494:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411828a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160509:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411828a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160526:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411828a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160533:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411828a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160537:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599379.160540:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411828a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160546:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411828a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160553:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f6c70860600) 00010000:00010000:3.0:1787599379.160555:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599379.160558:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411828a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160564:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411828a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160603:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071d6 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160617:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc67411828ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071d6 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.160624:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:3.0:1787599379.160627:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787599379.160645:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c800, rc 0) 00000100:00100000:3.0:1787599379.160740:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:10297:x1874433522297984:12345-192.168.204.30@tcp:101:bash.0 Request processed in 1429us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599379.160749:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:0.0:1787599379.166524:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599379.166678:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522298240 00000100:00100000:1.0:1787599379.166692:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522298240 00000100:00100000:1.0:1787599379.166767:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:1.0:1787599379.166781:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:10297:x1874433522298240:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1787599379.166812:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599379.166844:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc67411828b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.167808:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411828bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.167831:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411828bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.167847:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411828bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.168107:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.168132:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.168145:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599379.170289:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787599379.170616:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170631:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170644:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170683:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411828bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170691:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411828bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170699:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411828bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170705:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599379.170710:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411828bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170728:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411828bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170743:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599379.170751:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599379.170756:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411828bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170762:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411828bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599379.170775:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afd834a8 reply state 00000000354a6471 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599379.170785:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787599379.170825:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc67411828b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071dd expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170839:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071dd expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.170847:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c50836700) 00010000:00010000:1.0:1787599379.170849:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599379.170851:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8400, rc 0) 00000100:00100000:1.0:1787599379.174318:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:10297:x1874433522298240:12345-192.168.204.30@tcp:101:bash.0 Request processed in 7528us (7800us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787599379.174332:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00010000:00010000:1.0:1787599379.181827:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.181868:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.181876:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.181882:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599379.181889:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.181897:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.181916:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c50836200) 00010000:00010000:1.0:1787599379.181920:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599379.181925:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.181932:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411828c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599379.192598:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599379.192752:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522298368 00000100:00100000:1.0:1787599379.192763:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522298368 00000100:00100000:1.0:1787599379.192819:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:1.0:1787599379.192828:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874433522298368:12345-192.168.204.30@tcp:8:bash.0 00010000:00080000:1.0:1787599379.192861:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:1.0:1787599379.192895:0:6679:0:(genops.c:1385:class_connect()) connect: client 3d8318fd-1d0f-4438-bc2c-ebacb6a98551, cookie 0xa46cbc67411828d8 00002000:00100000:1.0:1787599379.192908:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3d8318fd-1d0f-4438-bc2c-ebacb6a98551/ffff9f6c451ff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599379.192933:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599379.193199:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787599379.193354:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9f6c451f9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599379.193544:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2355:x1874433522298368:12345-192.168.204.30@tcp:8:bash.0 Request processed in 714us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599379.193553:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1787599379.224107:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599379.224798:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522298496 00000100:00100000:0.0:1787599379.224810:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522298496 00000100:00080000:3.0:1787599379.224964:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599379.226280:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1787599379.226302:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:0:x1874433522298496:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599379.226324:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599379.226349:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc67411828df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071e4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599379.226413:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787599379.226432:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1787599379.226437:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599379.226447:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc67411828df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071e4 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.226468:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc67411828df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071e4 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.226483:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff600, rc 0) 00000100:00100000:0.0:1787599379.226559:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:0:x1874433522298496:12345-192.168.204.30@tcp:101:bash.0 Request processed in 268us (2465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599379.226567:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:2.0:1787599379.234036:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599379.234186:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522298624 00000100:00100000:0.0:1787599379.234199:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522298624 00000100:00100000:0.0:1787599379.234427:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:0.0:1787599379.234439:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:10297:x1874433522298624:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599379.234459:0:11786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599379.234481:0:11786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071eb expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.234517:0:11786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc67411828df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071e4 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.234547:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599379.234551:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599379.234558:0:11786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 8 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.234594:0:11786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc67411828df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071e4 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.234607:0:11786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc67411828df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071e4 expref: 8 pid: 6677 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599379.234622:0:11786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11786:1874433543305600:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599379.234726:0:11786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c762e7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599379.240415:0:11786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11786:1874433543305600:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599379.240453:0:11786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 8 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.240474:0:11786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe800, rc 0) 00000100:00100000:0.0:1787599379.240533:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:10297:x1874433522298624:12345-192.168.204.30@tcp:101:bash.0 Request processed in 6097us (6509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599379.240543:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:2.0:1787599379.245938:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599379.246054:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522298752 00000100:00100000:0.0:1787599379.246065:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522298752 00010000:00010000:0.0:1787599379.246108:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc67411828df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071e4 expref: 8 pid: 6677 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599379.246212:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:0.0:1787599379.246223:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2357:x1874433522298752:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599379.246239:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599379.246264:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc67411828df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071e4 expref: 8 pid: 6677 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.246278:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc67411828df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071e4 expref: 8 pid: 6677 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.246303:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc67411828df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071e4 expref: 8 pid: 6677 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.246320:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599379.246325:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599379.246334:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.246346:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.246398:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599379.246414:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1874433543305728:192.168.204.30@tcp:105: 00000100:00100000:0.0:1787599379.246509:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c762e7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599379.249403:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1874433543305728:192.168.204.30@tcp:105: 00010000:00010000:0.0:1787599379.249431:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599379.249501:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2357:x1874433522298752:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 3279us (3571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599379.249512:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:3.0:1787599379.255975:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599379.256092:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522299008 00000100:00100000:1.0:1787599379.256102:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522299008 00000100:00100000:1.0:1787599379.256197:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1787599379.256210:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+11:10297:x1874433522299008:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:1.0:1787599379.256645:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:10297:x1874433522299008:12345-192.168.204.30@tcp:35:bash.0 Request processed in 429us (671us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787599379.256655:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:2.0:1787599379.351833:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599379.352422:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522299264 00000100:00100000:3.0:1787599379.352433:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522299264 00000100:00100000:3.0:1787599379.352502:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:3.0:1787599379.352514:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:10307:x1874433522299264:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599379.352540:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599379.352559:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411828ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599379.352669:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787599379.353347:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411828ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071f2 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.353374:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:3.0:1787599379.353377:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599379.353383:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411828ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071f2 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.353400:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d200, rc 0) 00000100:00100000:2.0:1787599379.353819:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:10307:x1874433522299264:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1306us (1994us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787599379.353828:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:3.0:1787599379.356470:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599379.356620:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522299520 00000100:00100000:0.0:1787599379.356629:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522299520 00000100:00100000:0.0:1787599379.356690:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:0.0:1787599379.356698:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:10307:x1874433522299520:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1787599379.356995:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:10307:x1874433522299520:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 296us (533us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787599379.357003:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00010000:00010000:2.0:1787599379.425640:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599379.437538:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599379.437680:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522299648 00000100:00100000:2.0:1787599379.437693:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522299648 00000100:00100000:2.0:1787599379.437767:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:2.0:1787599379.437779:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:10313:x1874433522299648:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599379.437813:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599379.437858:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411828fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e071f9 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.437944:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182902 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.437961:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.437975:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599379.438065:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787599379.438069:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599379.438100:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.438134:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411828fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071f9 expref: 16 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.438205:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071f9 expref: 15 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.438215:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:2.0:1787599379.438218:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599379.438223:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618600, rc 0) 00000100:00100000:2.0:1787599379.438307:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:10313:x1874433522299648:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 530us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599379.438315:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:3.0:1787599379.449881:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599379.450014:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522299904 00000100:00100000:0.0:1787599379.450028:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522299904 00000100:00100000:0.0:1787599379.450115:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:0.0:1787599379.450127:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:10313:x1874433522299904:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599379.450204:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599379.450229:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182909 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07200 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.450343:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.450371:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.450404:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599379.450419:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787599379.450715:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182909 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07200 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.450742:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07200 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.450752:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c50836700) 00010000:00010000:1.0:1787599379.450756:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599379.450761:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe400, rc 0) 00000100:00100000:1.0:1787599379.450843:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+17:10313:x1874433522299904:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 718us (976us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787599379.450852:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:3.0:1787599379.454890:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599379.454965:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599379.455206:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522300160 00000100:00100000:1.0:1787599379.455231:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522300160 00000100:00100000:1.0:1787599379.455308:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:1.0:1787599379.455401:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+17:10313:x1874433522300160:12345-192.168.204.30@tcp:101:lfs.0 00000100:00100000:0.0:1787599379.455432:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522300288 00010000:00010000:1.0:1787599379.455437:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787599379.455450:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522300288 00010000:00010000:1.0:1787599379.455470:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118291e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07207 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599379.455573:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:0.0:1787599379.455585:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:2356:x1874433522300288:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599379.455600:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182925 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.455604:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599379.455629:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.455931:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599379.455947:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787599379.457357:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182910 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07200 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.457395:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c50836700) 00010000:00010000:0.0:1787599379.457401:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599379.457553:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:2356:x1874433522300288:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 1968us (2585us total) trans 0 rc 0/0 00010000:00010000:1.0:1787599379.457564:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc674118291e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07207 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599379.457573:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00010000:00010000:1.0:1787599379.457608:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182925 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07207 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.457619:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c50836700) 00010000:00010000:1.0:1787599379.457622:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787599379.457626:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8a00, rc 0) 00000100:00100000:1.0:1787599379.457828:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:10313:x1874433522300160:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2508us (2950us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787599379.457838:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:3.0:1787599379.467377:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599379.467543:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522300416 00000100:00100000:1.0:1787599379.467557:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522300416 00000100:00100000:1.0:1787599379.467637:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1787599379.467650:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2356:x1874433522300416:12345-192.168.204.30@tcp:1:lfs.0 00010000:00010000:1.0:1787599379.467715:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.467742:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.467752:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599379.467757:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599379.467763:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.467808:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.467826:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599379.467845:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874433543305856:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599379.468436:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599379.476134:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874433543305856:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599379.476286:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599379.478872:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599379.479540:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522300544 00000100:00100000:1.0:1787599379.479556:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522300544 00002000:00100000:1.0:1787599379.479624:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9f6c7609d500 x1874433522300544/t0(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:235/0 lens 504/0 e 0 to 0 dl 1787599390 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599379.479637:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c7609d500 with x1874433522300544 ext(0->12) 00010000:00010000:1.0:1787599379.479650:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 8 pid: 11786 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.479670:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 8 pid: 11786 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599379.479678:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f6c7609d500 00000100:00100000:1.0:1787599379.479773:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1787599379.479785:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522300544:12345-192.168.204.30@tcp:4:lfs.0 00000001:00100000:3.0:1787599379.527315:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000001:00080000:1.0:1787599379.583593:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1787599379.584795:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2358:x1874433522300544:12345-192.168.204.30@tcp:4:lfs.0 Request processed in 104998us (105922us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787599379.584821:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00002000:00100000:3.0:1787599379.584840:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9f6c7609d500 x1874433522300544/t4294967299(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:235/0 lens 504/448 e 0 to 0 dl 1787599390 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787599379.584853:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c7609d500 with x1874433522300544 ext(0->12) 00010000:00010000:3.0:1787599379.584868:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.584904:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787599379.584914:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f6c7609d500 00000100:00100000:3.0:1787599379.589490:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599379.590561:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522300672 00000100:00100000:1.0:1787599379.590578:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522300672 00010000:00010000:0.0:1787599379.591467:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599379.591590:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:0.0:1787599379.591605:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2356:x1874433522300672:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599379.591627:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787599379.591657:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787599379.591660:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787599378 00002000:00010000:0.0:1787599379.591662:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787599378 00002000:00010000:0.0:1787599379.591683:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787599378 00002000:00010000:0.0:1787599379.591686:0:5818:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1787599379.591694:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.591711:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.591742:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000198cd1a/0xa46cbc67411828e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071eb expref: 7 pid: 11786 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.591763:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599379.591769:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599379.591775:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.591787:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.591829:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599379.591926:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522300672:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 324us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599379.591942:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00010000:00010000:1.0:1787599379.592607:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.592624:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.592664:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.592685:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.592694:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.592702:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599379.592707:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.592717:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.592738:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.592747:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ae32633/0xa46cbc6741182933 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599379.592839:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2356:x1874433522300416:12345-192.168.204.30@tcp:1:lfs.0 Request processed in 125189us (125486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599379.592849:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:3.0:1787599379.595754:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599379.595877:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522300928 00000100:00100000:2.0:1787599379.596347:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522300928 00000100:00100000:2.0:1787599379.596468:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:2.0:1787599379.596481:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:10313:x1874433522300928:12345-192.168.204.30@tcp:35:lfs.0 00000004:00010000:2.0:1787599379.596572:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182925 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07207 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599379.596978:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787599379.597374:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1787599379.600810:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1787599379.601423:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.601450:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071dd expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.601459:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.601529:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071dd expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.601552:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071dd expref: 22 pid: 5831 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599379.601571:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76092300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874433543305984:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599379.601770:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c411cacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599379.611950:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76092300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874433543305984:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599379.612002:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599379.613581:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599379.613838:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522301056 00000100:00100000:0.0:1787599379.613852:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522301056 00010000:00010000:0.0:1787599379.613913:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071dd expref: 23 pid: 5831 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599379.613970:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:0.0:1787599379.613982:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76093800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:2358:x1874433522301056:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599379.614001:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599379.614010:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071dd expref: 23 pid: 5831 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.614025:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071dd expref: 23 pid: 5831 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.614055:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc67411828ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071dd expref: 23 pid: 5831 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.614076:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c50836700) 00010000:00010000:0.0:1787599379.614083:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.614094:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.614102:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.614144:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599379.614292:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76093800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:2358:x1874433522301056:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 312us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599379.614302:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00010000:00010000:3.0:1787599379.614709:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.614719:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599379.614896:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787599379.615781:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787599379.615988:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76090700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874433543306112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787599379.616072:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599379.616115:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c41377300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599379.616296:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543306112 00000100:00100000:0.0:1787599379.616306:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543306112 00000100:00100000:0.0:1787599379.616378:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599379.616391:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874433543306112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787599379.616483:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874433543306112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599379.616491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599379.616918:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76090700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874433543306112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787599379.620391:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787599379.620555:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76090700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874433543306240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787599379.620738:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599379.620850:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c469c6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599379.622964:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543306240 00000100:00100000:0.0:1787599379.622986:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543306240 00000100:00100000:0.0:1787599379.623133:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599379.623147:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874433543306240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787599379.623670:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1874433543306240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 521us (2926us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787599379.623680:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599379.623804:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76090700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874433543306240:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787599379.623914:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787599379.623977:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.623988:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.623997:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.624003:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599379.624008:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.624015:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.624034:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c50836700) 00010000:00010000:3.0:1787599379.624037:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787599379.624042:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599379.624048:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc674118293a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787599379.624311:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787599379.624588:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787599379.624604:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336998446373ns, next at 337998442733ns, rc = 0 00000001:00080000:3.0:1787599379.624610:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787599379.624648:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c50836700) 00010000:00010000:3.0:1787599379.624652:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787599379.624671:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182925 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07207 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599379.624825:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+25:10313:x1874433522300928:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 28344us (29084us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787599379.624835:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000020:00080000:3.0:1787599379.624840:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787599379.629412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599379.629528:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522301184 00000100:00100000:2.0:1787599379.629542:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522301184 00000100:00100000:2.0:1787599379.629628:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:2.0:1787599379.629649:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+25:10313:x1874433522301184:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599379.629684:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599379.629712:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182941 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0720e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.629808:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182941 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0720e expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.629830:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182941 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0720e expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.629858:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599379.629862:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599379.629867:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619000, rc 0) 00000100:00100000:2.0:1787599379.629964:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:10313:x1874433522301184:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 325us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599379.629972:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:2.0:1787599379.641940:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599379.642061:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522301440 00000100:00100000:1.0:1787599379.642075:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522301440 00000100:00100000:1.0:1787599379.642397:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787599379.642430:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:10313:x1874433522301440:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1787599379.642896:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:10313:x1874433522301440:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 468us (970us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787599379.642906:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:3.0:1787599379.752122:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599379.753908:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522301696 00000100:00100000:2.0:1787599379.753928:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522301696 00000100:00100000:2.0:1787599379.754035:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:2.0:1787599379.754049:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:10323:x1874433522301696:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599379.754089:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599379.754119:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182948 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07215 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599379.754497:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787599379.756372:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182948 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07215 expref: 29 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.756403:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:2.0:1787599379.756407:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599379.756413:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182948 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07215 expref: 29 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.756433:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619200, rc 0) 00000100:00100000:2.0:1787599379.756553:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:10323:x1874433522301696:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2505us (4445us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787599379.756564:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:0.0:1787599379.764552:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599379.765440:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522301824 00000100:00100000:2.0:1787599379.765455:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522301824 00000100:00100000:2.0:1787599379.765592:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:2.0:1787599379.765606:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:10323:x1874433522301824:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:2.0:1787599379.765728:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182956 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.765769:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.765783:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.765804:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118295d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766020:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118295d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766032:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118295d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766210:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766220:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766227:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599379.766286:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766301:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766307:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182956 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766327:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766334:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599379.766340:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766348:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182956 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766374:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:2.0:1787599379.766378:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599379.766384:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182956 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766391:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766407:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118295d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766413:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118295d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766418:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118295d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766421:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599379.766424:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118295d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766440:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118295d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766449:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c70382f00) 00010000:00010000:2.0:1787599379.766452:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599379.766455:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118295d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766461:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118295d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766482:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766488:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766494:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766499:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599379.766501:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766507:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766514:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599379.766516:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599379.766519:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599379.766536:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599379.766648:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:10323:x1874433522301824:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1042us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599379.766660:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:3.0:1787599379.771389:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599379.771575:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522302080 00000100:00100000:1.0:1787599379.771589:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522302080 00000100:00100000:1.0:1787599379.771670:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1787599379.771684:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:10323:x1874433522302080:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1787599379.772121:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:10323:x1874433522302080:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 439us (747us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787599379.772130:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1787599379.810989:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599379.811353:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522302336 00000100:00100000:0.0:1787599379.811379:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522302336 00000100:00100000:0.0:1787599379.811455:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:0.0:1787599379.811467:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:10326:x1874433522302336:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599379.811502:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599379.811529:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118296b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0721c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.811627:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182972 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.811783:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182972 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.811799:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182972 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.811822:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182979 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.811829:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.811835:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812066:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812074:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812081:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599379.812182:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787599379.812308:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182972 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812315:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182972 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812322:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812337:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599379.812344:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812352:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182972 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812383:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:0.0:1787599379.812387:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599379.812395:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182972 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812403:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182972 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812420:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812425:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182979 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812431:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182979 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812436:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599379.812438:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182979 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812443:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182979 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812461:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c43a07100) 00010000:00010000:0.0:1787599379.812464:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599379.812467:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182979 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812473:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182979 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812531:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118296b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0721c expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812546:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0721c expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599379.812554:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:0.0:1787599379.812556:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599379.812558:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fee00, rc 0) 00000100:00100000:0.0:1787599379.812662:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:10326:x1874433522302336:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1195us (1687us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787599379.812671:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:0.0:1787599379.815808:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599379.815918:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522302464 00000100:00100000:1.0:1787599379.815932:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522302464 00000100:00100000:1.0:1787599379.816308:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:1.0:1787599379.816323:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:10326:x1874433522302464:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:1.0:1787599379.816445:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc674118298e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.816466:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc674118298e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.816478:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc674118298e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.816511:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc674118298e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.816517:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc674118298e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.816540:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc674118298e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.816546:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599379.816551:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc674118298e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.816558:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc674118298e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.816575:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:1.0:1787599379.816578:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599379.816583:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc674118298e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599379.816591:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc674118298e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599379.816698:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:10326:x1874433522302464:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 377us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599379.816706:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:3.0:1787599379.818648:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599379.818788:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522302720 00000100:00100000:0.0:1787599379.818803:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522302720 00000100:00100000:0.0:1787599379.818880:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1787599379.818895:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:10326:x1874433522302720:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1787599379.819302:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:10326:x1874433522302720:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 407us (673us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787599379.819349:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:3.0:1787599380.047383:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599380.048665:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522302976 00000100:00100000:2.0:1787599380.048693:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522302976 00000100:00080000:3.0:1787599380.049210:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599380.049247:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:2.0:1787599380.049264:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:10357:x1874433522302976:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:2.0:1787599380.049301:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599380.049340:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182995 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07223 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.049499:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118299c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.049519:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118299c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.049539:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118299c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599380.049851:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787599380.050053:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182995 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07223 expref: 35 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.050079:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118299c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07223 expref: 34 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.050108:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.050112:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599380.050117:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619e00, rc 0) 00000100:00100000:2.0:1787599380.050639:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:10357:x1874433522302976:12345-192.168.204.30@tcp:101:cat.0 Request processed in 1377us (3268us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787599380.050651:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:3.0:1787599380.059059:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599380.059234:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599380.059685:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522303360 00000100:00100000:1.0:1787599380.059700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522303360 00000100:00100000:1.0:1787599380.059771:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1787599380.059783:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:10357:x1874433522303360:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:1.0:1787599380.060363:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:10357:x1874433522303360:12345-192.168.204.30@tcp:35:cat.0 Request processed in 571us (1118us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787599380.060372:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:2.0:1787599380.061875:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522303104 00000100:00100000:2.0:1787599380.061892:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522303104 00000100:00100000:2.0:1787599380.061986:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:2.0:1787599380.061999:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58442850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:2357:x1874433522303104:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599380.062018:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599380.062055:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc674118299c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07223 expref: 35 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.062082:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.062088:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599380.062218:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58442850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:2357:x1874433522303104:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 221us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599380.062227:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:3.0:1787599380.142949:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599380.143092:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522303616 00000100:00100000:2.0:1787599380.143110:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522303616 00000100:00100000:2.0:1787599380.143230:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:2.0:1787599380.143244:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:10363:x1874433522303616:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:2.0:1787599380.143282:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599380.143287:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787599380.143692:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182902 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071f9 expref: 34 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.143724:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:2.0:1787599380.143730:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599380.143751:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411829aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0722a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.143899:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.143916:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0721c expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.143926:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.143970:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0721c expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.143988:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0721c expref: 34 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599380.144008:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543306368:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599380.144437:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48af7300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599380.159566:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543306368:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599380.159609:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599380.161563:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599380.162923:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522303744 00000100:00100000:0.0:1787599380.162944:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522303744 00010000:00010000:0.0:1787599380.163012:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0721c expref: 35 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599380.163075:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:0.0:1787599380.163330:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:2358:x1874433522303744:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599380.163365:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599380.163376:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0721c expref: 35 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.163391:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0721c expref: 35 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.163419:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0721c expref: 35 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.163440:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:0.0:1787599380.163447:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.163772:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.163785:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.163869:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599380.163971:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:2358:x1874433522303744:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 883us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599380.163980:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00010000:00010000:2.0:1787599380.164071:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.164080:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599380.164108:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787599380.164607:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc67411829aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0722a expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.164633:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0722a expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.164643:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.164646:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787599380.164649:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619400, rc 0) 00000100:00100000:2.0:1787599380.164698:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:10363:x1874433522303616:12345-192.168.204.30@tcp:101:dd.0 Request processed in 21457us (21763us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787599380.164707:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:3.0:1787599380.167456:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599380.168721:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522304000 00000100:00100000:0.0:1787599380.168743:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522304000 00000100:00100000:0.0:1787599380.168854:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:0.0:1787599380.168875:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:10363:x1874433522304000:12345-192.168.204.30@tcp:36:dd.0 00010000:00010000:0.0:1787599380.169511:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.169537:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.169554:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599380.169645:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787599380.169704:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000300c1c9b reply state 00000000367ddd75 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599380.169717:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599380.169899:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+37:10363:x1874433522304000:12345-192.168.204.30@tcp:36:dd.0 Request processed in 1027us (2454us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787599380.169911:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000020:00080000:0.0:1787599380.169919:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787599380.174088:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.174115:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.174124:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.174130:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fee00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599380.174192:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.174202:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.174229:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.174233:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599380.174238:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.174245:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411829bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599380.452133:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599380.452233:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599380.453334:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522304128 00000100:00100000:1.0:1787599380.453364:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522304128 00000100:00100000:1.0:1787599380.453465:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:1.0:1787599380.453479:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+36:10377:x1874433522304128:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:1.0:1787599380.453521:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599380.453555:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411829c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07231 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.453656:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411829cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.453674:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411829cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.453690:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411829cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.453709:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc67411829d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.453715:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc67411829d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.453722:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc67411829d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.453860:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.453950:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0722a expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.453986:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.454034:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0722a expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.454050:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0722a expref: 37 pid: 5832 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599380.454067:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543306496:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599380.455296:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599380.465585:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599380.466331:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522304384 00000100:00100000:2.0:1787599380.466356:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522304384 00000100:00100000:2.0:1787599380.466508:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:2.0:1787599380.466524:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:5596:x1874433522304384:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787599380.466564:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543306496:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599380.466605:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599380.467215:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:5596:x1874433522304384:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 694us (1645us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787599380.467226:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1787599380.470832:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599380.471790:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522304512 00000100:00100000:0.0:1787599380.471807:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522304512 00010000:00010000:0.0:1787599380.471892:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0722a expref: 39 pid: 5832 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599380.472020:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:0.0:1787599380.472034:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:2359:x1874433522304512:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599380.472055:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599380.472064:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0722a expref: 39 pid: 5832 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.472081:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0722a expref: 39 pid: 5832 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.472110:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc67411829b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0722a expref: 39 pid: 5832 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.472132:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:0.0:1787599380.472138:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.472214:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.472225:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.472261:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599380.472337:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:2359:x1874433522304512:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 306us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599380.472355:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00010000:00010000:2.0:1787599380.472923:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.472934:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599380.473005:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787599380.473011:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599380.473068:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473097:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473109:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411829cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473116:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411829cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473135:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411829cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473141:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599380.473152:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411829cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473187:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411829cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473201:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:2.0:1787599380.473204:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599380.473208:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411829cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473215:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc67411829cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473229:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc67411829d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473236:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc67411829d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473249:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc67411829d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473254:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599380.473257:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc67411829d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473264:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc67411829d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473272:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c50836f00) 00010000:00010000:2.0:1787599380.473275:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599380.473278:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc67411829d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473284:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc67411829d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473332:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc67411829c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07231 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473356:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07231 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.473363:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.473365:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599380.473368:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8200, rc 0) 00000100:00100000:2.0:1787599380.473414:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+37:10377:x1874433522304128:12345-192.168.204.30@tcp:101:stat.0 Request processed in 19938us (21191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599380.473432:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:3.0:1787599380.574595:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599380.574862:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522304768 00000100:00100000:2.0:1787599380.574876:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522304768 00000100:00100000:2.0:1787599380.574950:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:2.0:1787599380.574961:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+37:10383:x1874433522304768:12345-192.168.204.30@tcp:36:truncate.0 00010000:00010000:2.0:1787599380.575046:0:8189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599380.575083:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc67411829db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07231 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.575107:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.575112:0:8189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599380.575465:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.575481:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.575493:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599380.575554:0:8189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787599380.575581:0:8189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019021c54 reply state 0000000077f79156 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599380.575591:0:8189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599380.575975:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:10383:x1874433522304768:12345-192.168.204.30@tcp:36:truncate.0 Request processed in 1012us (1390us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787599380.575984:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00000020:00080000:2.0:1787599380.576008:0:8189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787599380.579520:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.579555:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.579565:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.579573:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599380.579579:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.579588:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.579611:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.579615:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599380.579621:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.579628:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599380.745716:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599380.746050:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522304896 00000100:00100000:2.0:1787599380.746064:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522304896 00000100:00100000:2.0:1787599380.746190:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:2.0:1787599380.746204:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:10398:x1874433522304896:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:2.0:1787599380.746243:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599380.746271:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07238 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.746402:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411829f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.746421:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411829f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.746438:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411829f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.746458:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411829f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.746467:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411829f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.746474:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411829f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.746605:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.746629:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.746636:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599380.747216:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787599380.747222:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599380.747252:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747284:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747295:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411829f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747303:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411829f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747310:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411829f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747316:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599380.747321:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411829f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747330:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411829f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747358:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:2.0:1787599380.747362:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599380.747367:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411829f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747373:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc67411829f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747391:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411829f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747398:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411829f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747410:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411829f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747416:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599380.747419:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411829f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747425:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411829f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747434:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c70382f00) 00010000:00010000:2.0:1787599380.747436:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599380.747439:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411829f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747444:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc67411829f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747493:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc67411829e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07238 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747507:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07238 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.747515:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.747517:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599380.747520:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618e00, rc 0) 00000100:00100000:2.0:1787599380.747621:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:10398:x1874433522304896:12345-192.168.204.30@tcp:101:stat.0 Request processed in 1419us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599380.747639:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:3.0:1787599380.855261:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599380.857268:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522305152 00000100:00100000:2.0:1787599380.857287:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522305152 00000100:00100000:2.0:1787599380.857384:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:2.0:1787599380.857397:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:10408:x1874433522305152:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599380.857418:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599380.857994:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0723f expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599380.858253:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787599380.858396:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a05 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0723f expref: 41 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.858412:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:2.0:1787599380.858416:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599380.858421:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0723f expref: 41 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.858511:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618600, rc 0) 00000100:00100000:2.0:1787599380.858592:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+40:10408:x1874433522305152:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1197us (3345us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787599380.858601:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:3.0:1787599380.865666:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599380.865801:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522305408 00000100:00100000:0.0:1787599380.865817:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522305408 00000100:00100000:0.0:1787599380.865897:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:0.0:1787599380.865910:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+40:10408:x1874433522305408:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1787599380.866385:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+41:10408:x1874433522305408:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 475us (732us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787599380.866395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1787599380.927302:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599380.927801:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522305664 00000100:00100000:1.0:1787599380.927816:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522305664 00000100:00100000:1.0:1787599380.927960:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:1.0:1787599380.927973:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+41:10414:x1874433522305664:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1787599380.928012:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599380.928043:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07246 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.928232:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.928251:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07238 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.928281:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.928330:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07238 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.928359:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07238 expref: 42 pid: 5832 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599380.928378:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543306624:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599380.930571:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599380.934759:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543306624:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599380.934803:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599380.935698:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599380.937300:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522305792 00000100:00100000:2.0:1787599380.937323:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522305792 00010000:00010000:2.0:1787599380.937411:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07238 expref: 43 pid: 5832 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599380.937658:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:2.0:1787599380.937673:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+43:2358:x1874433522305792:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599380.937694:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599380.937702:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07238 expref: 43 pid: 5832 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.937718:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07238 expref: 43 pid: 5832 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.937746:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc67411829fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07238 expref: 43 pid: 5832 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.937767:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.937774:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.937785:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.937793:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.937836:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599380.937931:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+42:2358:x1874433522305792:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 261us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599380.937940:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00010000:00010000:1.0:1787599380.939061:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.939080:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599380.939115:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787599380.939401:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07246 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.939429:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07246 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.939510:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:1.0:1787599380.939514:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599380.939518:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8600, rc 0) 00000100:00100000:1.0:1787599380.939592:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+42:10414:x1874433522305664:12345-192.168.204.30@tcp:101:bash.0 Request processed in 11620us (12306us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787599380.939602:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:3.0:1787599380.946777:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599380.946934:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522306048 00000100:00100000:0.0:1787599380.946947:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522306048 00000100:00100000:0.0:1787599380.947023:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:0.0:1787599380.947037:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+42:10414:x1874433522306048:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:0.0:1787599380.947479:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.947503:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599380.947517:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599380.947585:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787599380.947616:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb7e41d2 reply state 00000000ffc5cdb7 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599380.947626:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599380.947743:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+45:10414:x1874433522306048:12345-192.168.204.30@tcp:36:bash.0 Request processed in 707us (985us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787599380.947752:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000020:00080000:0.0:1787599380.947758:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787599380.949573:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.949618:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.949627:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.949635:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ffa00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599380.949641:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.949650:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.949670:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.949673:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599380.949679:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.949686:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182a28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599380.956489:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599380.960243:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522306176 00000100:00100000:2.0:1787599380.960266:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522306176 00000100:00100000:2.0:1787599380.960374:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:2.0:1787599380.960388:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+44:10414:x1874433522306176:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1787599380.960429:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599380.960459:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182a2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0724d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.960624:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.960649:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07246 expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.960659:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.960707:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07246 expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.960722:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07246 expref: 45 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599380.960741:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543306752:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599380.960866:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5b28bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599380.965522:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543306752:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599380.965577:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599380.969023:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599380.969138:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522306304 00000100:00100000:1.0:1787599380.969193:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522306304 00010000:00010000:1.0:1787599380.969256:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07246 expref: 46 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599380.969299:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:1.0:1787599380.969311:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+46:2359:x1874433522306304:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599380.969329:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599380.969348:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07246 expref: 46 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.969365:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07246 expref: 46 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.969394:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07246 expref: 46 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.969415:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:1.0:1787599380.969421:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.969464:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.969474:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599380.969514:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599380.969593:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+45:2359:x1874433522306304:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 282us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599380.969603:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 41 00010000:00010000:2.0:1787599380.969621:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.969633:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599380.969702:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787599380.969707:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599380.969738:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.969793:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182a2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0724d expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.969818:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0724d expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599380.969826:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599380.969829:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599380.969832:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618600, rc 0) 00000100:00100000:2.0:1787599380.969864:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+44:10414:x1874433522306176:12345-192.168.204.30@tcp:101:bash.0 Request processed in 9480us (13770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599380.969872:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:3.0:1787599380.973294:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599380.973410:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522306560 00000100:00100000:2.0:1787599380.973424:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522306560 00000100:00100000:2.0:1787599380.973506:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:2.0:1787599380.973520:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c79850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+44:10414:x1874433522306560:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:2.0:1787599380.973856:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c79850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+45:10414:x1874433522306560:12345-192.168.204.30@tcp:35:bash.0 Request processed in 339us (576us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787599380.973865:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:3.0:1787599381.061214:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599381.061366:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522306816 00000100:00100000:0.0:1787599381.061380:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522306816 00000100:00100000:0.0:1787599381.061463:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:0.0:1787599381.061476:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+45:10424:x1874433522306816:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599381.061512:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599381.061542:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182a3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07254 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599381.063310:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787599381.063540:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182a3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07254 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.063574:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:0.0:1787599381.063578:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599381.063585:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182a3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07254 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.063890:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe000, rc 0) 00000100:00100000:0.0:1787599381.063993:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+46:10424:x1874433522306816:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2518us (2795us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787599381.064003:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:3.0:1787599381.067727:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599381.069461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522306944 00000100:00100000:1.0:1787599381.069584:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522306944 00000100:00100000:1.0:1787599381.069727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:1.0:1787599381.069741:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+46:10424:x1874433522306944:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:1.0:1787599381.069878:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.069900:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.069914:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.069945:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.069952:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.069959:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070115:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070126:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070133:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599381.070213:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070228:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070234:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070242:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070249:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599381.070254:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070263:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070278:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599381.070281:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599381.070286:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070300:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070317:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070322:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070327:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070343:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599381.070346:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070352:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070361:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c50836200) 00010000:00010000:1.0:1787599381.070363:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599381.070365:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070370:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182a52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070383:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070388:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070400:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070405:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599381.070408:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070414:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070421:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:1.0:1787599381.070423:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599381.070426:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.070432:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599381.070559:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+46:10424:x1874433522306944:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 818us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599381.070569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:3.0:1787599381.073790:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599381.078510:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522307200 00000100:00100000:2.0:1787599381.078536:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522307200 00000100:00100000:2.0:1787599381.078642:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:2.0:1787599381.078657:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+46:10424:x1874433522307200:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1787599381.079749:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:10424:x1874433522307200:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 1087us (5963us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787599381.079783:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1787599381.117995:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599381.118242:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522307456 00000100:00100000:2.0:1787599381.118257:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522307456 00000100:00100000:2.0:1787599381.118367:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:2.0:1787599381.118381:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:10427:x1874433522307456:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599381.118427:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599381.118457:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182a60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0725b expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.118580:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182a67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.118600:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182a67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.118615:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182a67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.118635:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.118643:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.118651:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.119769:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182a75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.119812:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.119822:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599381.119837:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787599381.119992:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182a67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120000:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182a67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120008:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182a67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120014:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599381.120020:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182a67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120029:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182a67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120045:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:2.0:1787599381.120049:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599381.120054:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182a67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120061:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182a67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120077:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120089:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120095:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120100:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599381.120104:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120110:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120118:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c70382f00) 00010000:00010000:2.0:1787599381.120121:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599381.120123:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120130:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120241:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182a60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0725b expref: 50 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120257:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182a75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0725b expref: 49 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.120264:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599381.120267:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599381.120275:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619400, rc 0) 00000100:00100000:2.0:1787599381.120390:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:10427:x1874433522307456:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2010us (2410us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787599381.120401:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:3.0:1787599381.128568:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599381.128623:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599381.128739:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522307712 00000100:00100000:0.0:1787599381.128752:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522307712 00000100:00100000:0.0:1787599381.128852:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:0.0:1787599381.128865:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:2356:x1874433522307712:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599381.128885:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599381.128937:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182a75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0725b expref: 49 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.128960:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:0.0:1787599381.128967:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599381.129046:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+48:2356:x1874433522307712:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 183us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599381.129056:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1787599381.131594:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522307584 00000100:00100000:2.0:1787599381.131618:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522307584 00000100:00100000:2.0:1787599381.131731:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:2.0:1787599381.131748:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+48:10427:x1874433522307584:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:2.0:1787599381.132373:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.132396:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.132410:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.132460:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.132468:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.132476:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.132483:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599381.132487:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.132497:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.132525:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:2.0:1787599381.132528:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599381.132534:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599381.132541:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182a83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599381.132661:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+48:10427:x1874433522307584:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 916us (4105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599381.132685:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:3.0:1787599381.136838:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599381.140348:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522307968 00000100:00100000:0.0:1787599381.140377:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522307968 00000100:00100000:0.0:1787599381.140493:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:0.0:1787599381.140507:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+48:10427:x1874433522307968:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1787599381.141366:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:10427:x1874433522307968:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 855us (4924us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787599381.141378:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1787599381.316245:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599381.316404:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522308224 00000100:00100000:0.0:1787599381.316418:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522308224 00000100:00100000:0.0:1787599381.316506:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:0.0:1787599381.316520:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:10445:x1874433522308224:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:0.0:1787599381.316566:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599381.316595:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07262 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.316734:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182a91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.316753:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.316786:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599381.316801:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787599381.316986:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182a8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07262 expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.317013:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07262 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.317022:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:0.0:1787599381.317026:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787599381.317031:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fea00, rc 0) 00000100:00100000:0.0:1787599381.317133:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10445:x1874433522308224:12345-192.168.204.30@tcp:101:cat.0 Request processed in 616us (904us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787599381.317143:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:3.0:1787599381.348240:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599381.348393:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522308352 00000100:00100000:1.0:1787599381.348408:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522308352 00000100:00100000:1.0:1787599381.348488:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:1.0:1787599381.348501:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10446:x1874433522308352:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599381.348537:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599381.348564:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07269 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.348702:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182aa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.348721:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.348735:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599381.348822:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787599381.348828:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599381.348855:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.348888:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182a9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07269 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.348910:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07269 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.348921:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599381.348924:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599381.348929:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9e00, rc 0) 00000100:00100000:1.0:1787599381.349015:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10446:x1874433522308352:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 516us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599381.349024:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:3.0:1787599381.354681:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599381.354756:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522308736 00000100:00100000:2.0:1787599381.354772:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522308736 00000100:00100000:2.0:1787599381.354857:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:2.0:1787599381.354870:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10446:x1874433522308736:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1787599381.355408:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:10446:x1874433522308736:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 538us (739us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787599381.355418:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:3.0:1787599381.358033:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599381.359393:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522308864 00000100:00100000:0.0:1787599381.359412:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522308864 00000100:00100000:0.0:1787599381.359522:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:0.0:1787599381.359537:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:10446:x1874433522308864:12345-192.168.204.30@tcp:103:lfs.0 00010000:00010000:0.0:1787599381.359558:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787599381.359909:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182a36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0724d expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.359937:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182a91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07262 expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.359979:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182941 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0720e expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.359991:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:0.0:1787599381.360008:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599381.360256:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:10446:x1874433522308864:12345-192.168.204.30@tcp:103:lfs.0 Request processed in 720us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599381.360266:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:3.0:1787599381.363406:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599381.363524:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522308992 00000100:00100000:0.0:1787599381.363537:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522308992 00000100:00100000:0.0:1787599381.363644:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:0.0:1787599381.363657:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:10446:x1874433522308992:12345-192.168.204.30@tcp:58:lfs.0 00010000:00010000:0.0:1787599381.363849:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182aad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.363869:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599381.363883:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599381.364302:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599381.364575:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787599381.364662:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787599381.364808:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:10446:x1874433522308992:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 1150us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599381.364819:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:3.0:1787599381.386305:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599381.388062:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522309120 00000100:00100000:1.0:1787599381.388085:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522309120 00000100:00100000:1.0:1787599381.388236:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:1.0:1787599381.388248:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:10448:x1874433522309120:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599381.388276:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599381.388305:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ab4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07270 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388413:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182abb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388430:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182abb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388443:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182abb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388461:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388468:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388474:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388620:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388629:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388636:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599381.388695:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787599381.388700:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599381.388727:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388741:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388752:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182abb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388759:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182abb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388766:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182abb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388773:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599381.388779:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182abb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388788:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182abb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388803:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599381.388806:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599381.388812:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182abb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388818:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182abb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388852:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388859:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388865:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388871:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599381.388874:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388880:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388888:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c50836200) 00010000:00010000:1.0:1787599381.388891:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599381.388893:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182ac2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388899:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388937:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ab4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07270 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388952:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07270 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599381.388971:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:1.0:1787599381.388973:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599381.388977:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8200, rc 0) 00000100:00100000:1.0:1787599381.389080:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10448:x1874433522309120:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 833us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599381.389088:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00010000:00010000:2.0:1787599381.473371:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599381.538512:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599381.538544:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543306880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599381.538748:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599381.538823:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543306880 00000100:00100000:1.0:1787599381.538836:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543306880 00000100:00100000:1.0:1787599381.538936:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787599381.538951:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543306880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599381.539004:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599381.539104:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543306880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599381.539113:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787599381.539260:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543306880:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787599381.539313:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599382.149286:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.149341:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.149402:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.149433:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522309504 00000100:00100000:3.0:1787599382.149442:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522309504 00000100:00100000:3.0:1787599382.149505:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:3.0:1787599382.149517:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522309504:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599382.149590:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522309504:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.149609:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:3.0:1787599382.149650:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522309376 00000100:00100000:3.0:1787599382.149654:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522309376 00000100:00100000:3.0:1787599382.149685:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:3.0:1787599382.149693:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522309376:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599382.149721:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522309376:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.149727:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00080000:3.0:1787599382.149742:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599382.149746:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599382.152076:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522309248 00000100:00100000:2.0:1787599382.152089:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522309248 00000100:00100000:2.0:1787599382.152143:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 291 00000100:00100000:2.0:1787599382.152153:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522309248:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599382.152241:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522309248:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 89us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599382.152260:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 291 00000040:00080000:1.0:1787599382.189538:0:11978:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599382.189550:0:11978:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599382.189593:0:11978:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787599382.189600:0:11978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787599382.370662:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599382.370675:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599382.370734:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787599382.370742:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787599382.370869:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543307008:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787599382.370963:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5b3b9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599382.376978:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599382.377376:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543307008:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599382.377810:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522309632 00000100:00100000:0.0:1787599382.377821:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522309632 00000100:00100000:0.0:1787599382.377950:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:0.0:1787599382.377961:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10460:x1874433522309632:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787599382.378035:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10460:x1874433522309632:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 Request processed in 77us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599382.378042:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00080000:0.0:1787599382.378061:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599382.384017:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599382.384211:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522309760 00000100:00100000:2.0:1787599382.384236:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522309760 00000100:00100000:3.0:1787599382.384385:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:3.0:1787599382.384398:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10460:x1874433522309760:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787599382.384434:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787599382.384559:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10460:x1874433522309760:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 164us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.384568:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:3.0:1787599382.390507:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.390554:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522309888 00000100:00100000:3.0:1787599382.390564:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522309888 00000100:00100000:3.0:1787599382.390630:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:3.0:1787599382.390641:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10460:x1874433522309888:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787599382.390729:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ad0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390748:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390777:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390796:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182ad7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390804:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390813:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390843:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390852:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390859:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599382.390899:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787599382.390904:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599382.390920:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390931:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390938:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ad0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390952:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390958:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599382.390963:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390970:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.390991:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:3.0:1787599382.390995:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599382.391000:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ad0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391006:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ad0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391025:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391032:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391038:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391043:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599382.391046:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391061:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391071:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9f6c70860400) 00010000:00010000:3.0:1787599382.391074:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599382.391099:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182ad7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391105:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182ad7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391133:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391141:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391147:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391177:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599382.391181:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391188:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391198:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:3.0:1787599382.391201:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599382.391204:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.391220:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599382.391304:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10460:x1874433522309888:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 663us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.391322:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:2.0:1787599382.398798:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.398933:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522310144 00000100:00100000:3.0:1787599382.398945:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522310144 00000100:00100000:3.0:1787599382.399001:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:3.0:1787599382.399013:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10460:x1874433522310144:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599382.399036:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599382.399058:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182ae5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07277 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399208:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182aec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399224:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399235:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599382.399246:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787599382.399359:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399367:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182aec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399385:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182aec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399391:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599382.399396:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182aec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399405:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182aec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399418:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:3.0:1787599382.399421:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599382.399426:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182aec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399432:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182aec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399476:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182ae5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07277 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399487:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:3.0:1787599382.399490:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599382.399494:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182ae5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07277 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.399504:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c600, rc 0) 00000100:00100000:3.0:1787599382.399569:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10460:x1874433522310144:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 558us (781us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787599382.400017:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:3.0:1787599382.404753:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599382.405935:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522310272 00000100:00100000:0.0:1787599382.405946:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522310272 00000100:00100000:0.0:1787599382.406010:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:0.0:1787599382.406021:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10460:x1874433522310272:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787599382.406059:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787599382.406240:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10460:x1874433522310272:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 219us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599382.406248:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:3.0:1787599382.411607:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599382.411708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522310528 00000100:00100000:2.0:1787599382.411719:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522310528 00000100:00100000:2.0:1787599382.411781:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:2.0:1787599382.411792:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10460:x1874433522310528:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599382.411813:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599382.411817:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787599382.411845:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182aa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07269 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.411863:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:2.0:1787599382.411868:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599382.411881:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182afa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0727e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787599382.412796:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787599382.413068:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.413082:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.413093:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.413178:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182afa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0727e expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.413204:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0727e expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.413212:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382f00) 00010000:00010000:2.0:1787599382.413215:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599382.413217:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618e00, rc 0) 00000100:00100000:2.0:1787599382.413279:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:10460:x1874433522310528:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1488us (1681us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787599382.413288:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:2.0:1787599382.422735:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599382.422883:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522310784 00000100:00100000:0.0:1787599382.422893:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522310784 00000100:00100000:0.0:1787599382.422958:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:0.0:1787599382.422970:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:10460:x1874433522310784:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599382.423028:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599382.423057:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0727e expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423076:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382f00) 00010000:00010000:0.0:1787599382.423103:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599382.423128:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182b0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423152:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182b0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423195:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182b0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423211:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xaf3ec6fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423219:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf3ec6fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423226:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf3ec6fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423320:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182b0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423328:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182b0f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423334:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182b0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423340:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ffe00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599382.423344:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182b0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423352:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182b0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423369:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:0.0:1787599382.423371:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599382.423376:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182b0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423382:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182b0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423393:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf3ec6fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423399:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf3ec6fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423406:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf3ec6fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423411:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599382.423414:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf3ec6fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423420:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf3ec6fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423427:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xaf3ec6fa (ffff9f6c43a07300) 00010000:00010000:0.0:1787599382.423429:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599382.423432:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaf3ec6fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.423438:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaf3ec6fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599382.423545:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10460:x1874433522310784:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 577us (820us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599382.423553:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:0.0:1787599382.428948:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599382.429045:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522310912 00000100:00100000:2.0:1787599382.429055:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522310912 00000100:00100000:2.0:1787599382.429119:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:2.0:1787599382.429131:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10460:x1874433522310912:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599382.432706:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599382.432756:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182b1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07285 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.432806:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.432822:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.432835:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.432960:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07285 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.432983:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07285 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.432993:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:2.0:1787599382.432996:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787599382.432999:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619200, rc 0) 00000100:00100000:2.0:1787599382.433090:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:10460:x1874433522310912:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 3960us (4164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599382.433100:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:1.0:1787599382.445809:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599382.446209:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522311168 00000100:00100000:0.0:1787599382.446220:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522311168 00000100:00100000:0.0:1787599382.446286:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:0.0:1787599382.446297:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:10460:x1874433522311168:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599382.446393:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.446412:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.446426:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599382.446867:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1787599382.446879:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339820721544ns, next at 340820718896ns, rc = 0 00000004:00010000:1.0:1787599382.446965:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eea1443e reply state 00000000c3635be2 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599382.447331:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787599382.447450:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:10460:x1874433522311168:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 1153us (1648us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787599382.447458:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 75 00010000:00010000:2.0:1787599382.458684:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.458701:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.458709:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.458716:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599382.458721:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.458729:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.458746:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:2.0:1787599382.458763:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787599382.458768:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.458775:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182b2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599382.459354:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.460064:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522311296 00000100:00100000:3.0:1787599382.460076:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522311296 00000100:00100000:3.0:1787599382.460142:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:3.0:1787599382.460192:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:10460:x1874433522311296:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599382.460224:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599382.460248:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182b32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0728c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.460323:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182b32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0728c expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.460347:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182b32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0728c expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.460369:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:3.0:1787599382.460381:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787599382.460384:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c600, rc 0) 00000100:00100000:3.0:1787599382.460447:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:10460:x1874433522311296:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 295us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.460454:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:1.0:1787599382.465709:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599382.466042:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522311424 00000100:00100000:0.0:1787599382.466053:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522311424 00000100:00100000:0.0:1787599382.466110:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:0.0:1787599382.466119:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874433522311424:12345-192.168.204.30@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787599382.466196:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:1.0:1787599382.466461:0:6677:0:(genops.c:1385:class_connect()) connect: client 3d8318fd-1d0f-4438-bc2c-ebacb6a98551, cookie 0xa46cbc6741182b39 00002000:00100000:1.0:1787599382.466476:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3d8318fd-1d0f-4438-bc2c-ebacb6a98551/ffff9f6c75f2b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599382.466488:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599382.467699:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787599382.467748:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9f6b4664b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599382.467850:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2355:x1874433522311424:12345-192.168.204.30@tcp:8:lhsmtool_posix.0 Request processed in 1727us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599382.467862:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:0.0:1787599382.472084:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.472202:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522311552 00000100:00100000:3.0:1787599382.472213:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522311552 00000100:00100000:3.0:1787599382.472282:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:3.0:1787599382.472293:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:0:x1874433522311552:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787599382.472718:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787599382.498363:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599382.532047:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:0:x1874433522311552:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 59744us (59960us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787599382.532062:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000001:00100000:3.0:1787599382.532100:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000001:00080000:3.0:1787599382.532114:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1787599382.535278:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599382.536984:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522311808 00000100:00100000:0.0:1787599382.537003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522311808 00000100:00100000:0.0:1787599382.537200:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1787599382.537233:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:10460:x1874433522311808:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787599382.537740:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10460:x1874433522311808:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 508us (2590us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787599382.537749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1787599382.543805:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.544376:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522312064 00000100:00100000:3.0:1787599382.544393:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522312064 00000100:00100000:3.0:1787599382.544498:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:3.0:1787599382.544516:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10460:x1874433522312064:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787599382.544840:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10460:x1874433522312064:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 328us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.544859:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:3.0:1787599382.549273:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599382.552509:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522312192 00000100:00100000:2.0:1787599382.552526:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522312192 00000100:00100000:2.0:1787599382.552599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:2.0:1787599382.552609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10460:x1874433522312192:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599382.552633:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599382.552656:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07293 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.552932:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.552948:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.552959:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599382.552997:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599382.553014:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.553040:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07293 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.553079:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07293 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.553088:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:2.0:1787599382.553091:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787599382.553094:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619000, rc 0) 00000100:00100000:2.0:1787599382.553246:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:10460:x1874433522312192:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 637us (3984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599382.553253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:1.0:1787599382.565204:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599382.565359:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522312320 00000100:00100000:0.0:1787599382.565372:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522312320 00000100:00100000:0.0:1787599382.565426:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:0.0:1787599382.565437:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522312320:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599382.565456:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599382.565481:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000198cd1a/0xa46cbc6741182b4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0729a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599382.565511:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9a15, blocks: 0x1 00010000:00010000:0.0:1787599382.565532:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1787599382.565537:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599382.565549:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000198cd1a/0xa46cbc6741182b4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0729a expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.565571:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000198cd1a/0xa46cbc6741182b4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0729a expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.565585:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe800, rc 0) 00000100:00100000:0.0:1787599382.565658:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522312320:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 217us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599382.565683:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:0.0:1787599382.579052:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599382.579222:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522312576 00000100:00100000:1.0:1787599382.579244:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522312576 00000100:00100000:1.0:1787599382.579421:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:1.0:1787599382.579436:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:10460:x1874433522312576:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787599382.579645:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:10460:x1874433522312576:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 211us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599382.579653:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:3.0:1787599382.587028:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599382.587330:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522312704 00000100:00100000:1.0:1787599382.587345:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522312704 00000100:00100000:1.0:1787599382.587432:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:1.0:1787599382.587447:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:10460:x1874433522312704:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599382.587631:0:11786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599382.587664:0:11786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072a1 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599382.587705:0:11786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000198cd1a/0xa46cbc6741182b4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0729a expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599382.587715:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599382.587721:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599382.587726:0:11786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599382.587772:0:11786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000198cd1a/0xa46cbc6741182b4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0729a expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599382.587789:0:11786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000198cd1a/0xa46cbc6741182b4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0729a expref: 7 pid: 6678 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599382.587806:0:11786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11786:1874433543307136:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599382.587942:0:11786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7004a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599382.597001:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599382.597274:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522312832 00000100:00100000:0.0:1787599382.597293:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522312832 00000100:00100000:1.0:1787599382.597999:0:11786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11786:1874433543307136:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599382.598051:0:11786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 8 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599382.598342:0:11786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8600, rc 0) 00010000:00010000:0.0:1787599382.598513:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000198cd1a/0xa46cbc6741182b4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0729a expref: 8 pid: 6678 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599382.598547:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:10460:x1874433522312704:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 11099us (11532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599382.598568:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:0.0:1787599382.598597:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:0.0:1787599382.598611:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58440c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522312832:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599382.598628:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599382.598653:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000198cd1a/0xa46cbc6741182b4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0729a expref: 7 pid: 6678 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.598671:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000198cd1a/0xa46cbc6741182b4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0729a expref: 7 pid: 6678 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.598694:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000198cd1a/0xa46cbc6741182b4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0729a expref: 7 pid: 6678 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.598710:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599382.598715:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599382.599030:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 6 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.599041:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 6 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.599099:0:8431:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 6 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599382.599115:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8431:1874433543307264:192.168.204.30@tcp:105: 00000100:00100000:1.0:1787599382.602387:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c762e7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599382.617795:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8431:1874433543307264:192.168.204.30@tcp:105: 00010000:00010000:1.0:1787599382.617825:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599382.617887:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58440c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522312832:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 19278us (20901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599382.617899:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:0.0:1787599382.621858:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599382.622059:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522312960 00000100:00100000:2.0:1787599382.622070:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522312960 00002000:00100000:2.0:1787599382.622127:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9f6c74f87b80 x1874433522312960/t0(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:238/0 lens 504/0 e 0 to 0 dl 1787599393 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599382.622140:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c74f87b80 with x1874433522312960 ext(0->8) 00002000:00010000:2.0:1787599382.622146:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c74f87b80 00000100:00100000:2.0:1787599382.622209:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1787599382.622285:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522312960:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787599382.623513:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522312960:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 Request processed in 1226us (1787us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787599382.623525:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00002000:00100000:2.0:1787599382.623536:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9f6c74f87b80 x1874433522312960/t4294967302(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:238/0 lens 504/448 e 0 to 0 dl 1787599393 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599382.623560:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c74f87b80 with x1874433522312960 ext(0->8) 00002000:00010000:2.0:1787599382.623565:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c74f87b80 00000100:00100000:3.0:1787599382.632299:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599382.632534:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522313088 00000100:00100000:0.0:1787599382.632556:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522313088 00000100:00100000:0.0:1787599382.632626:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:0.0:1787599382.632636:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:10460:x1874433522313088:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787599382.699461:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1787599382.699506:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1787599382.699790:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787599382.699839:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:10460:x1874433522313088:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 67199us (67544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599382.699966:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599382.699986:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543307392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787599382.700042:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599382.700421:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:2.0:1787599382.701681:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543307520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787599382.701881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599382.701945:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543307392 00000100:00100000:1.0:1787599382.701953:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543307392 00000100:00100000:1.0:1787599382.702003:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543307520 00000100:00100000:1.0:1787599382.702007:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543307520 00000100:00100000:1.0:1787599382.702044:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599382.702054:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543307392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787599382.702094:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599382.702105:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1874433543307520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787599382.702125:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787599382.702183:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c9a12, atime: 0x6a8c9a12, ctime: 0x6a8c9a12, blocks: 0xb 00010000:00010000:0.0:1787599382.702193:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc6741182b5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.702213:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1787599382.702218:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599382.702225:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc6741182b5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.702243:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc6741182b5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599382.702254:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787599382.702258:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787599381 00002000:00010000:1.0:1787599382.702261:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787599382.702263:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787599381 -> 1787599381 00002000:00010000:1.0:1787599382.702265:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:0.0:1787599382.702281:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc6741182b5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.702290:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc6741182b5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787599382.702392:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f6c413773c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787599382.702397:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c7586bc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c41377300 00000020:00080000:3.0:1787599382.702401:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c7586b800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c75f30800 00010000:00010000:0.0:1787599382.702832:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599382.703614:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599382.703626:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc6741182b5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.703645:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599382.703651:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc6741182b5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.703660:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc6741182b5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.703680:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc6741182b5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.703688:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000653804d3/0xa46cbc6741182b5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.703711:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599382.703712:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599382.703715:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599382.705399:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599382.706998:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874433543307392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4939us (6949us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787599382.707028:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599382.707063:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522313216 00000100:00100000:1.0:1787599382.707073:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522313216 00000100:00100000:1.0:1787599382.707111:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:1.0:1787599382.707121:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522313216:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787599382.708133:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1874433543307520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6025us (6246us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787599382.708147:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787599382.708176:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1787599382.708191:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787599382.708398:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:2.0:1787599382.708709:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c483b0380/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787599382.708729:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543307520:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1787599382.708747:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c7605fb80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787599382.708751:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543307392:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1787599382.757212:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1787599382.757231:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1787599382.758067:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522313216:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 50419us (52148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.758080:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1787599382.761927:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.762705:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522313472 00000100:00100000:3.0:1787599382.762851:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522313472 00000100:00100000:2.0:1787599382.763075:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:2.0:1787599382.763087:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:10460:x1874433522313472:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787599382.763143:0:8189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599382.763191:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07293 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.763210:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:2.0:1787599382.763215:0:8189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599382.763241:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.763253:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.763277:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599382.763531:0:8189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a831d42 reply state 00000000239e793e transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599382.763552:0:8189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599382.763658:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:10460:x1874433522313472:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 573us (1743us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787599382.763665:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:0.0:1787599382.769906:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:2.0:1787599382.769996:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.770008:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.770016:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.770023:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599382.770029:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.770037:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.770056:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:2.0:1787599382.770059:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599382.770064:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.770086:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182b63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599382.770692:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522313600 00000100:00100000:1.0:1787599382.770704:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522313600 00000100:00100000:1.0:1787599382.770780:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:1.0:1787599382.770800:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522313600:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787599382.771077:0:11786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787599382.771081:0:11786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787599381 -> 1787599379 00002000:00010000:1.0:1787599382.771085:0:11786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787599378 00002000:00010000:1.0:1787599382.771087:0:11786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787599381 -> 1787599379 00002000:00010000:1.0:1787599382.771089:0:11786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787599382.771733:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522313600:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 930us (1824us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787599382.771744:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:3.0:1787599382.775392:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599382.775513:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522313856 00000100:00100000:0.0:1787599382.775546:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522313856 00000100:00100000:0.0:1787599382.775625:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 82 00000100:00100000:0.0:1787599382.775637:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:10460:x1874433522313856:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787599382.775712:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.775745:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07285 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.775775:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.775814:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07285 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.775828:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07285 expref: 13 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599382.775843:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543307648:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599382.775956:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c762e7540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599382.778769:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543307648:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599382.778798:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599382.779306:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599382.779370:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522313984 00000100:00100000:2.0:1787599382.779386:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522313984 00010000:00010000:2.0:1787599382.779453:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07285 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599382.779499:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:2.0:1787599382.779512:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:2358:x1874433522313984:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599382.779532:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599382.779542:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07285 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.779557:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07285 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.779589:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07285 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.779612:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:2.0:1787599382.779618:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.779630:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.779654:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.779708:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599382.779737:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.779749:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.779789:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599382.779800:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:2358:x1874433522313984:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 286us (501us total) trans 0 rc 0/0 00010000:00010000:0.0:1787599382.779803:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599382.779823:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00010000:00010000:0.0:1787599382.779824:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.779855:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fee00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599382.779861:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.779870:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.779889:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:0.0:1787599382.779893:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787599382.779897:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.779902:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182b6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599382.779986:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:10460:x1874433522313856:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 Request processed in 4349us (4610us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787599382.779997:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 82 00000100:00100000:2.0:1787599382.782925:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599382.783017:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522314112 00000100:00100000:1.0:1787599382.783032:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522314112 00000100:00100000:1.0:1787599382.783098:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:1.0:1787599382.783109:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2357:x1874433522314112:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787599382.783199:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599382.783240:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599382.783250:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787599382.783256:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599382.783262:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599382.783466:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599382.783486:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 7 pid: 11786 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599382.783505:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874433543307776:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599382.783901:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c50f73e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599382.799520:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874433543307776:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599382.799571:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599382.804830:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.805415:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522314240 00000100:00100000:3.0:1787599382.805431:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522314240 00010000:00010000:3.0:1787599382.805500:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 8 pid: 11786 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599382.805558:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:3.0:1787599382.805569:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522314240:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599382.805583:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599382.805606:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 8 pid: 11786 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.805621:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 8 pid: 11786 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.805949:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ae32633/0xa46cbc6741182b55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a1 expref: 8 pid: 11786 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.805967:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599382.805971:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599382.805976:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.805985:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.806016:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599382.806066:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.806084:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.806128:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.806138:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.806147:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.806219:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599382.806226:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.806237:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.806258:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.806266:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b1dabdb/0xa46cbc6741182b71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599382.806378:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2357:x1874433522314112:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 23267us (23465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.806394:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522314240:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 818us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599382.806394:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:3.0:1787599382.806414:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:1.0:1787599382.810364:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599382.811797:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522314496 00000100:00100000:3.0:1787599382.811811:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522314496 00000100:00100000:2.0:1787599382.813790:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 83 00000100:00100000:2.0:1787599382.813806:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:10460:x1874433522314496:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787599382.813892:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.813909:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.813922:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.814204:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.814216:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182b32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0728c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.814225:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.814261:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182b32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0728c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.814276:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182b32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0728c expref: 13 pid: 5832 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599382.814291:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76091c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543307904:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599382.814418:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d8180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599382.819146:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76091c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543307904:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599382.819221:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599382.820745:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599382.822278:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522314624 00000100:00100000:0.0:1787599382.822307:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522314624 00010000:00010000:0.0:1787599382.822469:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182b32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0728c expref: 14 pid: 5832 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599382.822636:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:0.0:1787599382.822647:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:2358:x1874433522314624:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599382.822663:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599382.822670:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182b32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0728c expref: 14 pid: 5832 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.822702:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182b32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0728c expref: 14 pid: 5832 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.822723:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182b32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0728c expref: 14 pid: 5832 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.822739:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:0.0:1787599382.822744:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.822754:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.822762:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599382.822794:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599382.822857:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:2358:x1874433522314624:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 213us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599382.822865:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00010000:00010000:1.0:1787599382.822927:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599382.822936:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787599382.823149:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787599382.823365:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787599382.823437:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787599382.823532:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543308032:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787599382.823610:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599382.823653:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c50f73480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599382.824327:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543308032 00000100:00100000:3.0:1787599382.824343:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543308032 00000100:00100000:3.0:1787599382.824414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599382.824428:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1874433543308032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787599382.824581:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1874433543308032:12345-0@lo:1000:mdt00_000.0 Request processed in 156us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599382.824590:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599382.824668:0:5831:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787599382.824676:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c7605fb80, transno 4294967303 00000100:00100000:2.0:1787599382.826392:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543308032:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787599382.830114:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787599382.830497:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76091c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543308160:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787599382.830932:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599382.831014:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599382.834323:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543308160 00000100:00100000:0.0:1787599382.834446:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543308160 00000100:00100000:0.0:1787599382.834721:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599382.834735:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5831:x1874433543308160:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787599382.835031:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5831:x1874433543308160:12345-0@lo:1000:mdt00_000.0 Request processed in 300us (4099us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787599382.835040:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599382.835200:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76091c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543308160:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787599382.835243:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835253:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835260:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835266:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599382.835271:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835279:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835306:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:2.0:1787599382.835310:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599382.835314:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835321:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835382:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835389:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182aad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835404:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182aad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835409:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599382.835412:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182aad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835418:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182aad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835427:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:2.0:1787599382.835429:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599382.835432:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182aad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835438:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182aad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835458:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835472:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07270 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835480:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835512:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07270 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.835550:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07270 expref: 16 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599382.835566:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76093480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543308288:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599382.835654:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599382.839552:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599382.839669:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522314752 00000100:00100000:2.0:1787599382.839687:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522314752 00000100:00100000:3.0:1787599382.839714:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76093480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543308288:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599382.839745:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07270 expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.839767:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599382.839798:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:2.0:1787599382.839811:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+17:2359:x1874433522314752:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599382.839827:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599382.839835:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07270 expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.839850:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07270 expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.839874:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182ac9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07270 expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.839892:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:2.0:1787599382.839896:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.839922:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.839930:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.839963:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599382.840035:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:2359:x1874433522314752:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 226us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599382.840043:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00010000:00010000:3.0:1787599382.840274:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.840285:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.840313:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.840321:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.840329:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.840336:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599382.841000:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.841035:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.841056:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:3.0:1787599382.841059:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599382.841065:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.841073:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182b86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.841737:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.841745:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.841753:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.841760:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599382.841764:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.841771:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.841783:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07100) 00010000:00010000:3.0:1787599382.841785:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599382.841789:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.841809:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182b78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599382.842521:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:10460:x1874433522314496:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 28710us (32156us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787599382.842534:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 83 00000040:00080000:1.0:1787599382.843111:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599382.843122:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599382.843182:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787599382.843191:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:0.0:1787599382.843737:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787599382.846711:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599382.846791:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522315008 00000100:00100000:2.0:1787599382.846807:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522315008 00000100:00100000:2.0:1787599382.846885:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1787599382.846895:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:10460:x1874433522315008:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787599382.848257:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787599382.848426:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787599382.848483:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.848499:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.848510:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.848518:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.848525:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.850170:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599382.850211:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599382.850240:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599382.850258:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.850272:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599382.850279:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.850292:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.850328:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:3.0:1787599382.850332:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787599382.850339:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.850346:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182b8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599382.850380:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599382.850383:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599382.850385:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599382.851847:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+17:10460:x1874433522315008:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 4941us (5142us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787599382.851861:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000020:00080000:2.0:1787599382.851869:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787599383.522693:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599383.585474:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543308672:0@lo:400:kworker.0 00000100:00100000:2.0:1787599383.585583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599383.585667:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599383.585674:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543308800:0@lo:400:kworker.0 00000100:00100000:2.0:1787599383.585700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599383.585837:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543308672 00000100:00100000:1.0:1787599383.585846:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543308672 00000100:00100000:1.0:1787599383.585903:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543308800 00000100:00100000:1.0:1787599383.585907:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543308800 00000100:00100000:1.0:1787599383.585947:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787599383.585959:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543308672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599383.585963:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543308416:0@lo:400:kworker.0 00000100:00100000:3.0:1787599383.586011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599383.586028:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543308672:12345-0@lo:400:kworker.0 Request processed in 71us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599383.586038:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787599383.586046:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543308928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599383.586059:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787599383.586081:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543308800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599383.586090:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599383.586118:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599383.586123:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543308800:12345-0@lo:400:kworker.0 Request processed in 43us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599383.586129:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543308544:0@lo:400:kworker.0 00000100:00100000:1.0:1787599383.586133:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787599383.586181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599383.586183:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543308928 00000100:00100000:1.0:1787599383.586188:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543308928 00000100:00100000:3.0:1787599383.586216:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543308544 00000100:00100000:1.0:1787599383.586221:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787599383.586222:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543308544 00000100:00100000:1.0:1787599383.586231:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543308928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599383.586255:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787599383.586264:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543308544:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787599383.586268:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599383.586318:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543308544:12345-0@lo:400:kworker.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599383.586326:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787599383.586329:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543308928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599383.586339:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787599383.586387:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543308800:0@lo:400:kworker.0 00000100:00100000:1.0:1787599383.586401:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543308672:0@lo:400:kworker.0 00000100:00100000:3.0:1787599383.586404:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543308416 00000100:00100000:3.0:1787599383.586409:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543308416 00000100:00100000:3.0:1787599383.586439:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787599383.586447:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543308416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599383.586481:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543308416:12345-0@lo:400:kworker.0 Request processed in 35us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599383.586488:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787599383.586543:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543308544:0@lo:400:kworker.0 00000100:00100000:3.0:1787599383.586555:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543308416:0@lo:400:kworker.0 00000100:00100000:3.0:1787599383.586572:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543308928:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787599383.587511:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787599384.039426:0:12031:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787599384.039436:0:12031:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787599384.039477:0:12031:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787599384.039483:0:12031:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787599384.146494:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599384.146587:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522315264 00000100:00100000:1.0:1787599384.146596:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522315264 00000100:00100000:1.0:1787599384.146678:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:1.0:1787599384.146688:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+17:10477:x1874433522315264:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599384.146714:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599384.146735:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182b94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072a8 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.146996:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182b9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.147012:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.147026:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599384.147039:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787599384.147247:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182b94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a8 expref: 20 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.147266:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182b9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a8 expref: 19 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.147297:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599384.147301:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599384.147306:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8600, rc 0) 00000100:00100000:1.0:1787599384.147369:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:10477:x1874433522315264:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 681us (882us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787599384.147376:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00080000:2.0:1787599384.147562:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599384.153510:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.153635:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522315392 00000100:00100000:0.0:1787599384.153644:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522315392 00000100:00100000:0.0:1787599384.153704:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:0.0:1787599384.153714:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:10477:x1874433522315392:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:0.0:1787599384.153798:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182ba9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.153815:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.153826:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.153841:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.153848:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.153855:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154334:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154343:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154362:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599384.154402:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154413:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154419:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182ba9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154425:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154431:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599384.154435:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154443:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182ba9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154454:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:0.0:1787599384.154457:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599384.154463:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182ba9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154469:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182ba9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154480:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154493:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154499:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154504:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599384.154508:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154514:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154522:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c43a07500) 00010000:00010000:0.0:1787599384.154524:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599384.154527:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154532:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154608:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154614:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154619:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154624:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ffe00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599384.154634:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154641:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154649:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07b00) 00010000:00010000:0.0:1787599384.154652:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599384.154655:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.154661:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741182bb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599384.154783:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:10477:x1874433522315392:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1068us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599384.154792:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:0.0:1787599384.212212:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.212247:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522315648 00000100:00100000:0.0:1787599384.212256:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522315648 00000100:00100000:0.0:1787599384.212317:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:0.0:1787599384.212328:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:10480:x1874433522315648:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599384.212348:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599384.212369:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072af expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212444:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212459:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212478:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212494:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182bcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212502:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212508:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212825:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212834:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212841:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599384.212850:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787599384.212938:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212946:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212952:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212958:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599384.212970:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212978:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.212990:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:0.0:1787599384.212993:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599384.212998:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.213004:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.213016:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.213022:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182bcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.213027:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.213033:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599384.213036:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.213042:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182bcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.214897:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c43a07b00) 00010000:00010000:0.0:1787599384.214906:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599384.214925:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182bcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.214934:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182bcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.214997:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182bbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072af expref: 22 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.215012:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072af expref: 21 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.215019:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599384.215022:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599384.215024:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe000, rc 0) 00000100:00100000:0.0:1787599384.215110:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:10480:x1874433522315648:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2783us (2906us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787599384.215119:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:3.0:1787599384.219958:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.220071:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522315776 00000100:00100000:0.0:1787599384.220082:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522315776 00000100:00100000:0.0:1787599384.220143:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:0.0:1787599384.220302:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:10480:x1874433522315776:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:0.0:1787599384.220373:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.220390:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.220402:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.220445:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.220452:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.220459:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.220466:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599384.220469:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.220476:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.220488:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599384.220491:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599384.220496:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.220502:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599384.220610:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:10480:x1874433522315776:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 457us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599384.220617:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:0.0:1787599384.224068:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599384.224237:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522316032 00000100:00100000:3.0:1787599384.224247:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522316032 00000100:00100000:3.0:1787599384.224462:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:3.0:1787599384.224475:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c7a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:10480:x1874433522316032:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1787599384.225080:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c7a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:10480:x1874433522316032:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 606us (1019us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787599384.229597:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:1.0:1787599384.262135:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.262466:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522316288 00000100:00100000:0.0:1787599384.262476:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522316288 00000100:00100000:0.0:1787599384.262752:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:0.0:1787599384.262764:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:9997:x1874433522316288:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599384.262791:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599384.262824:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072b6 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.262921:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.262935:0:8189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072af expref: 23 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.262945:0:8189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.262980:0:8189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072af expref: 23 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.262993:0:8189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072af expref: 23 pid: 8189 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599384.263007:0:8189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543309056:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599384.263105:0:8189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70877540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599384.267281:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599384.267433:0:8189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543309056:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599384.267461:0:8189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599384.268043:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522316416 00000100:00100000:2.0:1787599384.268051:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522316416 00010000:00010000:2.0:1787599384.268089:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072af expref: 24 pid: 8189 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599384.268199:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:2.0:1787599384.268210:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:2358:x1874433522316416:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599384.268225:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599384.268233:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072af expref: 24 pid: 8189 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.268262:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072af expref: 24 pid: 8189 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.268295:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072af expref: 24 pid: 8189 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.268320:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:2.0:1787599384.268324:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.268333:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.268341:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.268360:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599384.268426:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:2358:x1874433522316416:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 218us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599384.268434:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00010000:00010000:1.0:1787599384.268702:0:8189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.268710:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599384.268729:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787599384.269060:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182be8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072b6 expref: 24 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.269076:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072b6 expref: 23 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.269084:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:1.0:1787599384.269087:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599384.269097:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe200, rc 0) 00000100:00100000:1.0:1787599384.269128:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:9997:x1874433522316288:12345-192.168.204.30@tcp:101:bash.0 Request processed in 6367us (7003us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787599384.269135:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:3.0:1787599384.273747:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.273933:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522316672 00000100:00100000:0.0:1787599384.273943:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522316672 00000100:00100000:0.0:1787599384.274005:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:0.0:1787599384.274016:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:9997:x1874433522316672:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:0.0:1787599384.274731:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.274748:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.274758:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599384.274944:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787599384.274978:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000457da0c6 reply state 00000000891a5564 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599384.274987:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787599384.275040:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787599384.275316:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:9997:x1874433522316672:12345-192.168.204.30@tcp:36:bash.0 Request processed in 1298us (1575us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787599384.275324:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 89 00000020:00080000:0.0:1787599384.275329:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787599384.278373:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:2.0:1787599384.278630:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.278643:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.278650:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.278674:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fee00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599384.278679:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.278687:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.278705:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:2.0:1787599384.278708:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599384.278713:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.278720:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182bfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599384.278950:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522316800 00000100:00100000:1.0:1787599384.278959:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522316800 00000100:00100000:1.0:1787599384.279062:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 90 00000100:00100000:1.0:1787599384.279072:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:9997:x1874433522316800:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1787599384.279095:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599384.279112:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182c04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072bd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.279197:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072bd expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.279208:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072bd expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.279227:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:1.0:1787599384.279230:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599384.279232:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8a00, rc 0) 00000100:00100000:1.0:1787599384.279312:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:9997:x1874433522316800:12345-192.168.204.30@tcp:101:bash.0 Request processed in 234us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599384.279319:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 90 00000100:00100000:1.0:1787599384.281786:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599384.281981:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522316928 00000100:00100000:2.0:1787599384.281990:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522316928 00000100:00080000:1.0:1787599384.282285:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599384.282519:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1787599384.282533:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:9997:x1874433522316928:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1787599384.282551:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599384.282572:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc6741182c0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072c4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599384.282608:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c9a13, atime: 0x6a8c9a12, ctime: 0x6a8c9a13, blocks: 0xb 00010000:00010000:2.0:1787599384.282628:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1787599384.282633:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599384.282642:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc6741182c0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072c4 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.282679:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc6741182c0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072c4 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.282692:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618e00, rc 0) 00000100:00100000:2.0:1787599384.282757:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:9997:x1874433522316928:12345-192.168.204.30@tcp:101:bash.0 Request processed in 228us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599384.282764:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:3.0:1787599384.286256:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599384.286423:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522317056 00000100:00100000:1.0:1787599384.286433:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522317056 00002000:00010000:1.0:1787599384.286484:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787599384.286488:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c759b3b80 with x1874433522317056 ext(0->18446744073709551615) 00002000:00010000:1.0:1787599384.286499:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c759b3b80. 00000100:00100000:1.0:1787599384.286536:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:1.0:1787599384.286546:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522317056:12345-192.168.204.30@tcp:10:bash.0 00002000:00010000:1.0:1787599384.287492:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787599384.287497:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787599379 -> 1787599383 00002000:00010000:1.0:1787599384.287500:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787599378 -> 1787599378 00002000:00010000:1.0:1787599384.287502:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787599379 -> 1787599383 00002000:00010000:1.0:1787599384.287504:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787599384.287675:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522317056:12345-192.168.204.30@tcp:10:bash.0 Request processed in 1127us (1424us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787599384.287684:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00002000:00010000:1.0:1787599384.287689:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787599384.287692:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c759b3b80 with x1874433522317056 ext(0->18446744073709551615) 00002000:00010000:1.0:1787599384.287697:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c759b3b80. 00000100:00100000:0.0:1787599384.359888:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599384.359940:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522317184 00000100:00100000:3.0:1787599384.359952:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522317184 00000100:00100000:3.0:1787599384.360023:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 91 00000100:00100000:3.0:1787599384.360034:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:10494:x1874433522317184:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:3.0:1787599384.360107:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182c12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360124:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182c12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360134:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182c12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360147:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182c19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360184:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360201:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360498:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360508:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360516:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599384.360557:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360569:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182c12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360575:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182c12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360582:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182c12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360587:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599384.360591:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182c12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360598:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182c12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360611:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:3.0:1787599384.360620:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599384.360626:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182c12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360632:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182c12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360646:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360652:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182c19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360665:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182c19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360672:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599384.360675:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182c19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360681:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182c19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360689:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c70860e00) 00010000:00010000:3.0:1787599384.360691:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599384.360694:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182c19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360700:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182c19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360715:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360727:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360733:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360738:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599384.360741:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360746:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360754:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:3.0:1787599384.360757:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599384.360759:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.360765:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182c20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599384.360851:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:10494:x1874433522317184:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 817us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599384.360859:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 91 00000100:00100000:3.0:1787599384.406800:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.407140:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522317440 00000100:00100000:0.0:1787599384.407150:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522317440 00000100:00100000:0.0:1787599384.407433:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00100000:0.0:1787599384.407447:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:10497:x1874433522317440:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599384.407468:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599384.407487:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072cb expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.407576:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182c2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.407603:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182c2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.407615:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182c2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.407630:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.407637:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.407644:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408128:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182c3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408138:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408145:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599384.408194:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787599384.408417:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182c2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408425:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182c2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408432:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182c2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408445:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599384.408449:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182c2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408457:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182c2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408470:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:0.0:1787599384.408474:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599384.408478:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182c2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408485:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182c2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408497:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408503:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408508:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408513:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fee00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599384.408516:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408522:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408552:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c43a07b00) 00010000:00010000:0.0:1787599384.408555:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599384.408558:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408564:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408612:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072cb expref: 30 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408626:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072cb expref: 29 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.408633:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599384.408635:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787599384.408637:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe400, rc 0) 00000100:00100000:0.0:1787599384.408760:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:10497:x1874433522317440:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1315us (1967us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787599384.412720:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599384.412848:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522317568 00000100:00100000:2.0:1787599384.412857:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522317568 00000100:00100000:0.0:1787599384.413574:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00100000:2.0:1787599384.414433:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 93 00000100:00100000:2.0:1787599384.414451:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:10497:x1874433522317568:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:2.0:1787599384.414632:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.414870:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072b6 expref: 29 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.414879:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.414915:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072b6 expref: 29 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.414930:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072b6 expref: 29 pid: 8189 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599384.415083:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543309184:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599384.415206:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787599384.418213:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599384.418347:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522317824 00000100:00100000:1.0:1787599384.418357:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522317824 00000100:00100000:1.0:1787599384.418416:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:1.0:1787599384.418426:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+30:5596:x1874433522317824:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787599384.418931:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:5596:x1874433522317824:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 504us (722us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787599384.418938:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543309184:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599384.418942:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00010000:00010000:2.0:1787599384.418969:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599384.424083:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599384.424386:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522317952 00000100:00100000:2.0:1787599384.424397:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522317952 00010000:00010000:2.0:1787599384.424435:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072b6 expref: 31 pid: 8189 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599384.424661:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:2.0:1787599384.424672:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75debb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:2359:x1874433522317952:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599384.425651:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599384.425662:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072b6 expref: 31 pid: 8189 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.425677:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072b6 expref: 31 pid: 8189 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.425697:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182bef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072b6 expref: 31 pid: 8189 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.425714:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:2.0:1787599384.425719:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.425741:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.425748:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.425941:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599384.426008:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75debb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+30:2359:x1874433522317952:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 1336us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599384.426016:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00010000:00010000:1.0:1787599384.430581:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.430621:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.430658:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.430666:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.430674:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.430680:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599384.430684:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.430691:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.430709:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:1.0:1787599384.430712:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599384.430717:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.430723:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599384.431146:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:10497:x1874433522317568:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 16698us (18430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599384.431186:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 93 00000100:00100000:3.0:1787599384.433972:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599384.434066:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522318208 00000100:00100000:1.0:1787599384.434077:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522318208 00000100:00100000:1.0:1787599384.434135:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1787599384.434146:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:10497:x1874433522318208:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1787599384.434420:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+30:10497:x1874433522318208:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 275us (455us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787599384.434428:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00010000:00010000:3.0:1787599384.545402:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599384.553714:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599384.553918:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522318464 00000100:00100000:1.0:1787599384.553930:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522318464 00000100:00100000:1.0:1787599384.554008:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 94 00000100:00100000:1.0:1787599384.554020:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+30:10508:x1874433522318464:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:1.0:1787599384.554057:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599384.554084:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182c51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.554199:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.554214:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.554225:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.554238:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.554245:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.554282:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.554796:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182c66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.554815:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.554822:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182c66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599384.554893:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787599384.554991:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555000:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555006:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555012:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599384.555015:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555023:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555035:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599384.555038:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599384.555107:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555114:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555125:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555137:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555144:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555151:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599384.555234:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555246:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555254:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c50836000) 00010000:00010000:1.0:1787599384.555257:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599384.555260:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555278:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555334:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182c51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d2 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555366:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182c66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d2 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.555373:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:1.0:1787599384.555376:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599384.555379:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8400, rc 0) 00000100:00100000:1.0:1787599384.555450:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:10508:x1874433522318464:12345-192.168.204.30@tcp:101:cat.0 Request processed in 1427us (1741us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787599384.555459:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 94 00000100:00100000:3.0:1787599384.560592:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599384.560836:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522318720 00000100:00100000:1.0:1787599384.560847:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522318720 00000100:00100000:1.0:1787599384.560905:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1787599384.560915:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:10508:x1874433522318720:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:1.0:1787599384.561175:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+33:10508:x1874433522318720:12345-192.168.204.30@tcp:35:cat.0 Request processed in 243us (574us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787599384.561183:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:3.0:1787599384.596304:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.596665:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522318976 00000100:00100000:0.0:1787599384.596675:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522318976 00000100:00100000:0.0:1787599384.596737:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 95 00000100:00100000:0.0:1787599384.596748:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+33:10509:x1874433522318976:12345-192.168.204.30@tcp:36:rm.0 00010000:00010000:0.0:1787599384.596820:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787599384.596846:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182c66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d2 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.596890:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182c3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072cb expref: 32 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.596903:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182c04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072bd expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.596913:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599384.596922:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599384.596952:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.596965:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.596974:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.596986:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.596992:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.596998:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.598891:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182c82 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.598911:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182c82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.598923:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182c82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599384.600393:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787599384.600405:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341974248267ns, next at 342974245218ns, rc = 0 00010000:00010000:2.0:1787599384.600466:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600479:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600489:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600497:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600511:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600516:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600552:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599384.600577:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182c82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600584:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182c82 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600590:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182c82 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600596:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599384.600600:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182c82 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600607:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182c82 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600620:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382f00) 00010000:00010000:2.0:1787599384.600623:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787599384.600627:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182c82 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600649:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182c82 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600669:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600682:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c74 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600687:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600693:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599384.600696:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600702:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600710:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:2.0:1787599384.600713:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599384.600716:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.600721:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182c74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599384.600734:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e8960de reply state 00000000eac2c959 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599384.600743:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787599384.601209:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599384.601216:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.601224:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599384.601228:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.601235:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.601245:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f6c70382f00) 00010000:00010000:3.0:1787599384.601248:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787599384.601251:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.601256:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182c89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.601287:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599384.601289:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599384.601290:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599384.601510:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:10509:x1874433522318976:12345-192.168.204.30@tcp:36:rm.0 Request processed in 4758us (5212us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787599384.601519:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 95 00010000:00010000:3.0:1787599384.624403:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.624423:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.624432:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.624456:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fee00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599384.624462:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.624471:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.624490:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c43a07b00) 00010000:00010000:3.0:1787599384.624493:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599384.624498:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.625085:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182c7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599384.685794:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599384.685845:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522319232 00000100:00100000:1.0:1787599384.685855:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522319232 00000100:00100000:1.0:1787599384.685912:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:1.0:1787599384.685922:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:10515:x1874433522319232:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1787599384.685945:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599384.685965:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182c90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.686114:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.686129:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.686142:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.686173:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.686181:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.686187:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599384.687309:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787599384.687575:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687589:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687598:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687634:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687655:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687661:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687667:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599384.687672:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687679:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687691:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599384.687694:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599384.687699:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687705:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182c97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599384.687719:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fca0691 reply state 000000005e9656f4 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599384.687727:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787599384.687760:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182c90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d9 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687775:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d9 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599384.687794:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:1.0:1787599384.687797:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599384.687917:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8a00, rc 0) 00000100:00100000:1.0:1787599384.687995:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:10515:x1874433522319232:12345-192.168.204.30@tcp:101:bash.0 Request processed in 2073us (2210us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787599384.688004:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:1.0:1787599384.694759:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599384.694895:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522319360 00000100:00100000:3.0:1787599384.694905:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522319360 00000100:00100000:3.0:1787599384.694962:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:3.0:1787599384.694970:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522319360:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1787599384.694988:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1787599384.695188:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787599384.695534:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182cb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072e0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787599384.695563:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599384.695581:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1787599384.695585:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599384.695594:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182cb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e0 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.695627:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182cb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e0 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.695640:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d600, rc 0) 00000100:00100000:3.0:1787599384.695701:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522319360:12345-192.168.204.30@tcp:101:bash.0 Request processed in 730us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599384.695708:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00010000:00010000:2.0:1787599384.696455:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.696480:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.696487:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.696494:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599384.696499:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.696506:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.696520:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c50836200) 00010000:00010000:2.0:1787599384.696524:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599384.696528:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.696535:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182c9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599384.699517:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1787599384.699668:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599384.699717:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522319488 00000100:00100000:3.0:1787599384.699726:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522319488 00000100:00100000:3.0:1787599384.699820:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:3.0:1787599384.699831:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:10515:x1874433522319488:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1787599384.699849:0:11786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599384.699867:0:11786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072e7 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.699895:0:11786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182cb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e0 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.699905:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599384.699909:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599384.699914:0:11786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.699946:0:11786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182cb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e0 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.699970:0:11786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182cb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e0 expref: 7 pid: 6677 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599384.699984:0:11786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11786:1874433543309312:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599384.700095:0:11786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58297300 going to sleep for 11 seconds 00000100:00100000:3.0:1787599384.702547:0:11786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11786:1874433543309312:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599384.702579:0:11786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.702603:0:11786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d800, rc 0) 00000100:00100000:3.0:1787599384.702661:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:10515:x1874433522319488:12345-192.168.204.30@tcp:101:bash.0 Request processed in 2831us (2996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599384.702669:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:1.0:1787599384.703327:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.703486:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522319616 00000100:00100000:0.0:1787599384.703495:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522319616 00010000:00010000:0.0:1787599384.703531:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182cb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e0 expref: 7 pid: 6677 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599384.703587:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:0.0:1787599384.703597:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58443c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2358:x1874433522319616:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599384.703611:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599384.703632:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182cb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e0 expref: 7 pid: 6677 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.703645:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182cb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e0 expref: 7 pid: 6677 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.703669:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182cb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e0 expref: 7 pid: 6677 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.703682:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599384.703687:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599384.703695:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 6 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.703707:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 6 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.703743:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 6 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599384.703763:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5818:1874433543309440:192.168.204.30@tcp:105: 00000100:00100000:0.0:1787599384.703940:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70877540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599384.707007:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76120e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5818:1874433543309440:192.168.204.30@tcp:105: 00010000:00010000:0.0:1787599384.707034:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599384.707132:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58443c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522319616:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 3535us (3806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599384.707143:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:1.0:1787599384.708964:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599384.709096:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522319872 00000100:00100000:3.0:1787599384.709105:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522319872 00000100:00100000:3.0:1787599384.709470:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:3.0:1787599384.709481:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+33:10515:x1874433522319872:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:3.0:1787599384.709841:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:10515:x1874433522319872:12345-192.168.204.30@tcp:35:bash.0 Request processed in 360us (881us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787599384.709849:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:1.0:1787599384.884116:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599384.884255:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522320000 00000100:00100000:2.0:1787599384.884278:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522320000 00000100:00100000:2.0:1787599384.884336:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00100000:2.0:1787599384.884351:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:10531:x1874433522320000:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599384.884376:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599384.884403:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182cc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072ee expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.884498:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.884512:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.884522:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599384.884589:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787599384.884592:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599384.884610:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.884634:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182cc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072ee expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.884653:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072ee expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.884663:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:2.0:1787599384.884666:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599384.884669:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619400, rc 0) 00000100:00100000:2.0:1787599384.884735:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:10531:x1874433522320000:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 391us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599384.884742:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00100000:1.0:1787599384.888716:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599384.889860:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522320256 00000100:00100000:2.0:1787599384.889873:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522320256 00000100:00100000:2.0:1787599384.889956:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 98 00000100:00100000:2.0:1787599384.889967:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:10531:x1874433522320256:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599384.889997:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599384.890018:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182ccf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072f5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.890128:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.890141:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.890152:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599384.890192:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787599384.890320:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182ccf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072f5 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.890338:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072f5 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.890712:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:2.0:1787599384.890715:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599384.890719:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619200, rc 0) 00000100:00100000:2.0:1787599384.890790:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+37:10531:x1874433522320256:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 824us (2086us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787599384.890803:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 98 00000100:00100000:1.0:1787599384.894974:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.895073:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522320384 00000100:00100000:0.0:1787599384.895084:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522320384 00000100:00100000:0.0:1787599384.895149:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:0.0:1787599384.895191:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+37:2359:x1874433522320384:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599384.895208:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599384.895233:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072f5 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.895251:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:0.0:1787599384.895256:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599384.895315:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+36:2359:x1874433522320384:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 156us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599384.895322:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:3.0:1787599384.899571:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599384.899667:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522320640 00000100:00100000:2.0:1787599384.899690:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522320640 00000100:00100000:2.0:1787599384.899751:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:2.0:1787599384.899762:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+36:10531:x1874433522320640:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599384.899789:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599384.899820:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182ce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e072fc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.899919:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182ceb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.899935:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.899947:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182ceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599384.899960:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787599384.900101:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072fc expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.900118:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182ceb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072fc expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.900127:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:2.0:1787599384.900130:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787599384.900134:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619000, rc 0) 00000100:00100000:2.0:1787599384.900229:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:10531:x1874433522320640:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 468us (671us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787599384.900236:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:1.0:1787599384.917670:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599384.918374:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522320768 00000100:00100000:3.0:1787599384.918393:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522320768 00000100:00100000:3.0:1787599384.918471:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:3.0:1787599384.918482:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522320768:12345-192.168.204.30@tcp:1:lfs.0 00010000:00010000:3.0:1787599384.918536:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.918558:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 6 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.918567:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599384.918573:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599384.918578:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.918614:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 6 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.918629:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 6 pid: 11786 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599384.918644:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874433543309568:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599384.918749:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58297300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599384.923213:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599384.923351:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522320896 00000100:00100000:2.0:1787599384.923361:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522320896 00002000:00100000:2.0:1787599384.923416:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9f6c76093480 x1874433522320896/t0(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:240/0 lens 504/0 e 0 to 0 dl 1787599395 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599384.923427:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c76093480 with x1874433522320896 ext(0->8) 00010000:00010000:2.0:1787599384.923436:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 7 pid: 11786 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.923452:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 7 pid: 11786 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599384.923459:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f6c76093480 00000100:00100000:2.0:1787599384.923494:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1787599384.923504:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522320896:12345-192.168.204.30@tcp:4:lfs.0 00000100:00100000:2.0:1787599384.924244:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2359:x1874433522320896:12345-192.168.204.30@tcp:4:lfs.0 Request processed in 739us (1039us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787599384.924253:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00002000:00100000:2.0:1787599384.924273:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9f6c76093480 x1874433522320896/t4294967302(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:240/0 lens 504/448 e 0 to 0 dl 1787599395 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599384.924282:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c76093480 with x1874433522320896 ext(0->8) 00010000:00010000:2.0:1787599384.924289:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 9 pid: 11786 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.924303:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 9 pid: 11786 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599384.924321:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f6c76093480 00000100:00100000:3.0:1787599384.925069:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874433543309568:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599384.925098:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599384.928277:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599384.928381:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522321024 00000100:00100000:2.0:1787599384.928497:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522321024 00010000:00010000:2.0:1787599384.928598:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 9 pid: 11786 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599384.928649:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:2.0:1787599384.928659:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2358:x1874433522321024:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599384.928676:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787599384.928695:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787599384.928698:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787599383 00002000:00010000:2.0:1787599384.928701:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787599383 00002000:00010000:2.0:1787599384.928704:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787599383 00010000:00010000:2.0:1787599384.928710:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 9 pid: 11786 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.928725:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 9 pid: 11786 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.928749:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff042cc/0xa46cbc6741182cba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072e7 expref: 9 pid: 11786 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.928768:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599384.928774:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599384.928780:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.929029:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.929308:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599384.929388:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522321024:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 722us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599384.929398:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00010000:00010000:3.0:1787599384.931290:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.931324:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.931466:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.931476:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.931484:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.931491:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599384.931495:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.931505:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.931523:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.931595:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182cf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599384.931883:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2358:x1874433522320768:12345-192.168.204.30@tcp:1:lfs.0 Request processed in 13399us (14219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599384.931894:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:1.0:1787599384.936606:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599384.936713:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522321280 00000100:00100000:2.0:1787599384.936724:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522321280 00000100:00100000:2.0:1787599384.936781:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:2.0:1787599384.936791:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c78050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:10531:x1874433522321280:12345-192.168.204.30@tcp:35:lfs.0 00000004:00010000:2.0:1787599384.936875:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182ceb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072fc expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599384.937213:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787599384.937272:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787599384.937615:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787599384.937681:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.937697:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d9 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.937706:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.937741:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d9 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.937765:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d9 expref: 42 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599384.937781:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874433543309696:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599384.937862:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599384.943076:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.943222:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522321408 00000100:00100000:0.0:1787599384.943233:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522321408 00010000:00010000:0.0:1787599384.943292:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d9 expref: 43 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599384.943338:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:0.0:1787599384.943357:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+43:2359:x1874433522321408:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599384.943396:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599384.943404:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d9 expref: 43 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.943418:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d9 expref: 43 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.943442:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:0.0:1787599384.943448:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.943456:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.943464:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599384.943481:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599384.943548:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+43:2359:x1874433522321408:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 202us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599384.943557:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00010000:00010000:2.0:1787599384.944875:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182ca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072d9 expref: 42 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599384.944900:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874433543309696:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599384.944923:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.944933:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.944939:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599384.945125:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787599384.948025:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787599384.948520:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874433543309824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787599384.948701:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599384.948796:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599384.949018:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543309824 00000100:00100000:1.0:1787599384.949026:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543309824 00000100:00100000:1.0:1787599384.949126:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599384.949135:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1874433543309824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787599384.949254:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1874433543309824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599384.949272:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599384.949488:0:5834:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787599384.949494:0:5834:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000100:00080000:2.0:1787599384.949504:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787599384.949517:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c483b0380, transno 4294967301 00000100:00100000:3.0:1787599384.949544:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874433543309824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787599384.950022:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787599384.950288:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874433543309952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787599384.950329:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599384.950367:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58297c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599384.951184:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543309952 00000100:00100000:1.0:1787599384.951192:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543309952 00000100:00100000:1.0:1787599384.951241:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599384.951250:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1874433543309952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787599384.951699:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1874433543309952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 449us (1368us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787599384.951707:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599384.951866:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874433543309952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787599384.951925:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787599384.951969:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.951979:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.951986:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.951992:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599384.951997:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.952004:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.952031:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:3.0:1787599384.952106:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787599384.952112:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599384.952120:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182d00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787599384.952444:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787599384.952537:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787599384.952549:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342326391599ns, next at 343326389274ns, rc = 0 00000001:00080000:3.0:1787599384.952557:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787599384.952590:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:3.0:1787599384.952594:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787599384.952602:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182ceb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072fc expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599384.952703:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c78050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+45:10531:x1874433522321280:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 15913us (16332us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787599384.952712:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000020:00080000:3.0:1787599384.952716:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787599384.957124:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599384.957462:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522321536 00000100:00100000:2.0:1787599384.957473:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522321536 00000100:00100000:2.0:1787599384.957619:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 100 00000100:00100000:2.0:1787599384.957742:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+45:10531:x1874433522321536:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599384.957771:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599384.957863:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182d07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07303 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.957928:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182d07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07303 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.957944:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182d07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07303 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599384.957963:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599384.957966:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599384.957971:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619c00, rc 0) 00000100:00100000:2.0:1787599384.958077:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+46:10531:x1874433522321536:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 338us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599384.958085:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 100 00000100:00100000:3.0:1787599384.961967:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599384.962050:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522321792 00000100:00100000:0.0:1787599384.962062:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522321792 00000100:00100000:0.0:1787599384.962121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:0.0:1787599384.962132:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+46:10531:x1874433522321792:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1787599384.963119:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:10531:x1874433522321792:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 984us (1158us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787599384.963130:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:3.0:1787599385.080916:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599385.081574:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522321920 00000100:00100000:2.0:1787599385.081587:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522321920 00000100:00100000:2.0:1787599385.081720:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 101 00000100:00100000:2.0:1787599385.081732:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:10541:x1874433522321920:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:2.0:1787599385.081887:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182d0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.082020:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.082034:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.082065:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.082073:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.082080:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085148:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085188:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085200:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599385.085269:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085285:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085291:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182d0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085298:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085305:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599385.085309:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085316:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182d0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085330:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:0.0:1787599385.085333:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599385.085338:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182d0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085344:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182d0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085376:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085383:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182d15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085389:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085396:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599385.085399:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085406:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182d15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085414:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c70382b00) 00010000:00010000:0.0:1787599385.085416:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599385.085419:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182d15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085425:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085443:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085449:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085455:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085466:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599385.085469:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085474:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085482:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:0.0:1787599385.085484:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599385.085487:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.085492:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599385.085594:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:10541:x1874433522321920:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 3859us (4684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599385.085605:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 101 00000100:00100000:1.0:1787599385.135830:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599385.137603:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522322176 00000100:00100000:0.0:1787599385.137618:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522322176 00000100:00100000:0.0:1787599385.137691:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 102 00000100:00100000:0.0:1787599385.137702:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:10544:x1874433522322176:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599385.137725:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599385.137747:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0730a expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.137834:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.137868:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.137881:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.137909:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.137916:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.137923:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138078:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182d38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138086:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138093:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182d38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599385.138104:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787599385.138239:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138248:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138264:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138276:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599385.138281:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138289:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138301:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:0.0:1787599385.138304:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599385.138309:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138315:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138328:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138335:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138341:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138347:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599385.138350:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138356:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138373:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c43a07500) 00010000:00010000:0.0:1787599385.138375:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599385.138378:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138384:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138424:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0730a expref: 50 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138439:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182d38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0730a expref: 49 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.138448:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:0.0:1787599385.138450:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599385.138453:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fea00, rc 0) 00000100:00100000:0.0:1787599385.138528:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:10544:x1874433522322176:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 828us (2707us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787599385.138535:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 102 00000100:00100000:2.0:1787599385.144404:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599385.144488:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522322304 00000100:00100000:3.0:1787599385.144499:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522322304 00000100:00100000:3.0:1787599385.144618:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 103 00000100:00100000:3.0:1787599385.144631:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:10544:x1874433522322304:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1787599385.144944:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.144977:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.144989:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.145020:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.145027:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.145110:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.145116:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599385.145120:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.145127:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.145141:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599385.145144:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599385.145149:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.145278:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599385.145413:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:10544:x1874433522322304:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 782us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599385.145428:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 103 00000100:00100000:0.0:1787599385.148902:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599385.148981:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522322560 00000100:00100000:3.0:1787599385.148992:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522322560 00000100:00100000:3.0:1787599385.149141:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:3.0:1787599385.149152:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:10544:x1874433522322560:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1787599385.149451:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:10544:x1874433522322560:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 300us (557us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787599385.149459:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:1.0:1787599385.268287:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599385.268945:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522322816 00000100:00100000:0.0:1787599385.268956:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522322816 00000100:00100000:0.0:1787599385.269070:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 104 00000100:00100000:0.0:1787599385.269081:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:10554:x1874433522322816:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599385.269105:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599385.269108:0:8189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787599385.269143:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619400/0xa46cbc6741182cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072ee expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.269195:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:0.0:1787599385.269200:0:8189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599385.269213:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07311 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.269318:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.269331:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.269341:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599385.269352:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787599385.269468:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182d4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07311 expref: 52 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.269480:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07311 expref: 51 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.269487:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:0.0:1787599385.269489:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599385.269492:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff800, rc 0) 00000100:00100000:0.0:1787599385.269571:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10554:x1874433522322816:12345-192.168.204.30@tcp:101:bash.0 Request processed in 492us (1294us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787599385.269578:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 104 00000100:00100000:3.0:1787599385.272981:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599385.273438:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522323072 00000100:00100000:2.0:1787599385.273450:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522323072 00000100:00100000:2.0:1787599385.273508:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 105 00000100:00100000:2.0:1787599385.273517:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:10554:x1874433522323072:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:2.0:1787599385.273651:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787599385.273817:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07311 expref: 51 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.273837:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182d38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0730a expref: 50 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.273847:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599385.273851:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599385.274045:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.274058:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.274083:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599385.274133:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787599385.274179:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd61a3a0 reply state 0000000009552c46 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599385.274188:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599385.274289:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10554:x1874433522323072:12345-192.168.204.30@tcp:36:bash.0 Request processed in 772us (1316us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787599385.274296:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 105 00000020:00080000:2.0:1787599385.274300:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787599385.277724:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599385.277881:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522323200 00000100:00100000:0.0:1787599385.277896:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522323200 00000100:00100000:0.0:1787599385.277961:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 106 00000100:00100000:0.0:1787599385.277972:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10554:x1874433522323200:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599385.277998:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599385.278020:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07318 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.278343:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.278354:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.278362:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.278369:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599385.278375:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.278378:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.278385:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.278395:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.278445:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.278502:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599385.278506:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599385.278581:0:3285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.278592:0:3285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.278599:0:3285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 5/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.278619:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.282283:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.282304:0:5833:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:0.0:1787599385.282308:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619200/0xa46cbc6741182d62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.282337:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.282347:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.282354:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599385.282426:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787599385.282431:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599385.282453:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.282492:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182d69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07318 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.282509:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07318 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.282518:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:0.0:1787599385.282593:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599385.282598:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ffa00, rc 0) 00000100:00100000:0.0:1787599385.282831:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10554:x1874433522323200:12345-192.168.204.30@tcp:101:bash.0 Request processed in 4859us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599385.282840:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 106 00000100:00100000:3.0:1787599385.286082:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599385.286215:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522323456 00000100:00100000:0.0:1787599385.286226:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522323456 00000100:00100000:0.0:1787599385.286296:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:0.0:1787599385.286308:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:10554:x1874433522323456:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:0.0:1787599385.286600:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:10554:x1874433522323456:12345-192.168.204.30@tcp:35:bash.0 Request processed in 293us (540us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787599385.286607:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:3.0:1787599385.334450:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599385.336384:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522323584 00000100:00100000:0.0:1787599385.336469:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522323584 00000100:00100000:1.0:1787599385.336895:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 107 00000100:00100000:1.0:1787599385.336906:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:10560:x1874433522323584:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599385.336931:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599385.336955:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182d77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0731f expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599385.337041:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182d7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599385.337056:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599385.337079:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599385.337145:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787599385.337149:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599385.337201:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182d7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599385.337243:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741182d77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0731f expref: 55 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599385.337272:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182d7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0731f expref: 54 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599385.337281:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599385.337284:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599385.337287:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9200, rc 0) 00000100:00100000:1.0:1787599385.337371:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:10560:x1874433522323584:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 466us (2930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599385.337379:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 107 00000100:00100000:1.0:1787599385.345948:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599385.346260:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522323712 00000100:00100000:3.0:1787599385.346270:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522323712 00000100:00100000:3.0:1787599385.346326:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 108 00000100:00100000:3.0:1787599385.346337:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:10560:x1874433522323712:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599385.346360:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599385.346382:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07326 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346447:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182d8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346461:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182d8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346472:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182d8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346505:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346514:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346521:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346626:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182d9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346635:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346643:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599385.346678:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787599385.346682:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599385.346700:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346712:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182d9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346719:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182d8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346726:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182d8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346897:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182d8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346902:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599385.346907:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182d8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346914:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182d8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346926:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:3.0:1787599385.346929:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599385.346933:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182d8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346939:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182d8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346953:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346959:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182d93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346965:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346970:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599385.346974:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346989:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182d93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.346998:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c70860700) 00010000:00010000:3.0:1787599385.347000:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599385.347003:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182d93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.347009:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182d93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.347045:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182d85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07326 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.347319:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182d9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07326 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.347328:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599385.347330:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599385.347333:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24de00, rc 0) 00000100:00100000:3.0:1787599385.347410:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:10560:x1874433522323712:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1075us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599385.347418:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 108 00000100:00100000:0.0:1787599385.351987:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599385.352041:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599385.352138:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522323840 00000100:00100000:3.0:1787599385.352148:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522324096 00000100:00100000:1.0:1787599385.352150:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522323840 00000100:00100000:3.0:1787599385.352189:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522324096 00000100:00100000:3.0:1787599385.352241:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00100000:1.0:1787599385.352257:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:3.0:1787599385.352268:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10560:x1874433522324096:12345-192.168.204.30@tcp:101:lfs.0 00000100:00100000:1.0:1787599385.352271:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:2358:x1874433522323840:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599385.352288:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599385.352308:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599385.352329:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182d9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07326 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.352330:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182da1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0732d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599385.352365:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:1.0:1787599385.352371:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599385.352426:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:2358:x1874433522323840:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 160us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599385.352433:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00010000:00010000:3.0:1787599385.352456:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.352472:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07318 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.352482:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.352513:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07318 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.352534:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07318 expref: 55 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599385.352548:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543310080:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599385.352608:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c41377300 going to sleep for 11 seconds 00000100:00100000:3.0:1787599385.355742:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543310080:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599385.355770:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599385.356992:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599385.357083:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522324224 00000100:00100000:3.0:1787599385.357091:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522324224 00010000:00010000:3.0:1787599385.357132:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07318 expref: 56 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599385.357221:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:3.0:1787599385.357232:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:2359:x1874433522324224:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599385.357258:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599385.357267:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07318 expref: 56 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.357280:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07318 expref: 56 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.357303:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741182d70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07318 expref: 56 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.357319:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599385.357324:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.357335:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.357342:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.357375:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599385.357421:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:2359:x1874433522324224:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 191us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599385.357429:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00010000:00010000:2.0:1787599385.359531:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.359550:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599385.359577:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787599385.359758:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182da1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0732d expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.359785:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0732d expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.359940:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599385.359944:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787599385.359949:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d600, rc 0) 00000100:00100000:2.0:1787599385.360041:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:10560:x1874433522324096:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 7790us (7998us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787599385.360050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00100000:0.0:1787599385.364019:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599385.364123:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522324480 00000100:00100000:1.0:1787599385.364136:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522324480 00000100:00100000:1.0:1787599385.364264:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1787599385.364275:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:10560:x1874433522324480:12345-192.168.204.30@tcp:103:lfs.0 00010000:00010000:1.0:1787599385.364293:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599385.364320:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182d07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07303 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599385.364340:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:1.0:1787599385.364345:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599385.364392:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:10560:x1874433522324480:12345-192.168.204.30@tcp:103:lfs.0 Request processed in 119us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599385.364399:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1787599385.372925:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599385.373148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522324608 00000100:00100000:0.0:1787599385.373196:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522324608 00000100:00100000:0.0:1787599385.373271:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 110 00000100:00100000:0.0:1787599385.373283:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:10560:x1874433522324608:12345-192.168.204.30@tcp:58:lfs.0 00010000:00010000:0.0:1787599385.373388:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.373406:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599385.373419:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599385.373630:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787599385.373912:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:10560:x1874433522324608:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 629us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599385.373921:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 110 00000100:00100000:0.0:1787599385.378600:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599385.379581:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522324736 00000100:00100000:2.0:1787599385.379594:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522324736 00000100:00100000:2.0:1787599385.379664:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 111 00000100:00100000:2.0:1787599385.379675:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:10560:x1874433522324736:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599385.379697:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599385.379718:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182dbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07334 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.379777:0:8189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.379787:0:8189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182dbd lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07334 expref: 55 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.379808:0:8189:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.379821:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182dbd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07334 expref: 55 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.379836:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599385.379839:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599385.379844:0:8189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182dbd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07334 expref: 55 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.379852:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75618600, rc 0) 00000100:00100000:2.0:1787599385.379919:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:10560:x1874433522324736:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 245us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599385.379926:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 111 00010000:00010000:3.0:1787599385.570868:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787599385.953552:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599385.953564:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599385.953804:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787599385.953811:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787599385.953950:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543310208:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787599385.956208:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4814a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599385.965147:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599385.966472:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522324864 00000100:00100000:3.0:1787599385.966486:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522324864 00000100:00100000:3.0:1787599385.966567:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 112 00000100:00100000:3.0:1787599385.966578:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10561:x1874433522324864:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787599385.966614:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787599385.966768:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10561:x1874433522324864:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 192us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599385.966776:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 112 00000100:00100000:1.0:1787599385.966929:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ed180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543310208:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599385.989144:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599385.989416:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522324992 00000100:00100000:2.0:1787599385.989427:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522324992 00000100:00100000:2.0:1787599385.989491:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 113 00000100:00100000:2.0:1787599385.989503:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:10561:x1874433522324992:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787599385.989595:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182dc4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989612:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989625:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989695:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182dcb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989704:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182dcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989711:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182dcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989735:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989743:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989749:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599385.989788:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787599385.989803:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599385.989817:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989828:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989834:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989841:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989847:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599385.989851:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989859:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989872:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:2.0:1787599385.989875:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599385.989879:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182dc4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989885:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182dc4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989898:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182dcb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989904:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182dcb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989932:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182dcb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989937:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599385.989941:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182dcb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989947:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182dcb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989956:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9f6c70382000) 00010000:00010000:2.0:1787599385.989959:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599385.989961:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182dcb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989966:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182dcb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989983:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989988:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989992:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.989996:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599385.989999:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.990647:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.990662:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599385.990665:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599385.990669:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599385.990675:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599385.990775:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:10561:x1874433522324992:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 1272us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599385.990785:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 113 00000100:00100000:2.0:1787599385.996680:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599385.996762:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522325248 00000100:00100000:3.0:1787599385.996771:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522325248 00000100:00100000:3.0:1787599385.996831:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 114 00000100:00100000:3.0:1787599385.996841:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:10561:x1874433522325248:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599385.996863:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599385.996883:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182dd9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0733b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.996994:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182de0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997010:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997031:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599385.997045:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787599385.997143:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997151:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182de0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997217:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997224:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599385.997229:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997246:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182de0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997258:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599385.997261:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787599385.997264:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182de0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997270:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182de0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997315:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182dd9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0733b expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997326:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:3.0:1787599385.997329:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599385.997334:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182dd9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0733b expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599385.997344:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c200, rc 0) 00000100:00100000:3.0:1787599385.997402:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10561:x1874433522325248:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 562us (734us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787599385.997418:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 114 00000100:00100000:1.0:1787599386.005364:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599386.005486:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522325376 00000100:00100000:2.0:1787599386.005496:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522325376 00000100:00100000:2.0:1787599386.005890:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:2.0:1787599386.005901:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10561:x1874433522325376:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787599386.005942:0:8189:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1787599386.006378:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599386.006500:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10561:x1874433522325376:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 598us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599386.006517:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 115 00000100:00100000:1.0:1787599386.011997:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599386.012468:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522325632 00000100:00100000:3.0:1787599386.012480:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522325632 00000100:00100000:0.0:1787599386.012856:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00100000:0.0:1787599386.012871:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10561:x1874433522325632:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599386.012893:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599386.012896:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787599386.012923:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182d7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0731f expref: 56 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.012953:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:0.0:1787599386.012958:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599386.012972:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182dee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07342 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787599386.013473:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787599386.013757:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182df5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.013771:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.013873:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.014014:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182dee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07342 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.014041:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07342 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.014050:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599386.014053:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599386.014056:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff800, rc 0) 00000100:00100000:0.0:1787599386.014140:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:10561:x1874433522325632:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1273us (2155us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787599386.014149:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00100000:1.0:1787599386.018287:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.019818:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522325888 00000100:00100000:0.0:1787599386.019834:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522325888 00000100:00100000:0.0:1787599386.019908:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:0.0:1787599386.019920:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:10561:x1874433522325888:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599386.019985:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599386.020016:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182df5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07342 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020035:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599386.020044:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599386.020068:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020082:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020092:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020106:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc79e9bfa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020113:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc79e9bfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020120:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc79e9bfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020234:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020272:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e03 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020279:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020285:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599386.020289:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020296:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020305:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:0.0:1787599386.020307:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599386.020311:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e03 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020317:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020327:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc79e9bfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020332:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc79e9bfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020338:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc79e9bfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020342:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fee00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599386.020351:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc79e9bfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020358:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc79e9bfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020365:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc79e9bfa (ffff9f6c43a07f00) 00010000:00010000:0.0:1787599386.020368:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599386.020371:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc79e9bfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.020376:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc79e9bfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599386.020473:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10561:x1874433522325888:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 554us (2193us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599386.020480:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:1.0:1787599386.029804:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599386.029891:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522326016 00000100:00100000:3.0:1787599386.029913:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522326016 00000100:00100000:3.0:1787599386.030035:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:3.0:1787599386.030048:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:10561:x1874433522326016:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599386.030070:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599386.030094:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182e11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07349 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.030132:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.030146:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.030185:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.030299:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07349 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.030318:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07349 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.030327:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:3.0:1787599386.030330:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599386.030342:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d000, rc 0) 00000100:00100000:3.0:1787599386.030404:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:10561:x1874433522326016:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 359us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599386.030411:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:1.0:1787599386.033772:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.034050:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522326272 00000100:00100000:0.0:1787599386.034061:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522326272 00000100:00100000:0.0:1787599386.034117:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:0.0:1787599386.034127:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:10561:x1874433522326272:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599386.034309:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.034327:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.034338:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599386.034953:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787599386.034980:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343408822567ns, next at 344408820130ns, rc = 0 00000004:00010000:0.0:1787599386.035134:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5b3fdb8 reply state 00000000e77f8ab8 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599386.035146:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599386.035304:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:10561:x1874433522326272:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 1175us (1540us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787599386.035312:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 119 00010000:00010000:2.0:1787599386.036884:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.036911:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.036947:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.036954:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fee00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599386.036958:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.036966:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.036982:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:2.0:1787599386.036985:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787599386.036990:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.036996:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599386.044575:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.044691:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522326400 00000100:00100000:0.0:1787599386.044703:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522326400 00000100:00100000:0.0:1787599386.044764:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:0.0:1787599386.044775:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:10561:x1874433522326400:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599386.044802:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599386.044823:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07350 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.044882:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07350 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.044896:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07350 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.044929:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:0.0:1787599386.044932:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599386.044935:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe400, rc 0) 00000100:00100000:0.0:1787599386.045000:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:10561:x1874433522326400:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 226us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599386.045008:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:1.0:1787599386.066801:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599386.066981:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522326528 00000100:00100000:2.0:1787599386.066993:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522326528 00000100:00100000:2.0:1787599386.067081:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:2.0:1787599386.067094:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522326528:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787599386.067443:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2358:x1874433522326528:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 350us (661us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787599386.067452:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00080000:1.0:1787599386.069456:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599386.085357:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.085517:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522326784 00000100:00100000:0.0:1787599386.085529:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522326784 00000100:00100000:0.0:1787599386.085593:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1787599386.085606:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:10561:x1874433522326784:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787599386.086625:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:10561:x1874433522326784:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 1017us (1272us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787599386.086638:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1787599386.103875:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599386.103979:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522327040 00000100:00100000:2.0:1787599386.103989:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522327040 00000100:00100000:2.0:1787599386.104054:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:2.0:1787599386.104065:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:10561:x1874433522327040:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787599386.104227:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:10561:x1874433522327040:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 163us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599386.104327:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:1.0:1787599386.107498:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.107592:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522327168 00000100:00100000:0.0:1787599386.107603:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522327168 00000100:00100000:0.0:1787599386.107675:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:0.0:1787599386.107686:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:10561:x1874433522327168:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599386.107707:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599386.107728:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07357 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.107818:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.107928:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.107946:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599386.107986:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599386.108005:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.108045:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07357 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.108063:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07357 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.108072:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:0.0:1787599386.108075:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787599386.108079:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff600, rc 0) 00000100:00100000:0.0:1787599386.108143:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:10561:x1874433522327168:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 459us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599386.108150:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:1.0:1787599386.110780:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599386.111047:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522327296 00000100:00100000:2.0:1787599386.111058:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522327296 00000100:00100000:2.0:1787599386.111120:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:2.0:1787599386.111131:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2359:x1874433522327296:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599386.111151:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599386.111216:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c63a404d/0xa46cbc6741182e3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0735e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599386.111255:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9a19, blocks: 0x1 00010000:00010000:2.0:1787599386.111274:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1787599386.111279:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599386.111289:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c63a404d/0xa46cbc6741182e3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0735e expref: 10 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.111309:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c63a404d/0xa46cbc6741182e3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0735e expref: 10 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.111322:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619c00, rc 0) 00000100:00100000:2.0:1787599386.111374:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:2359:x1874433522327296:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 245us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599386.111381:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:1.0:1787599386.115113:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599386.115286:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522327552 00000100:00100000:2.0:1787599386.115309:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522327552 00000100:00100000:2.0:1787599386.115397:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:2.0:1787599386.115408:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:10561:x1874433522327552:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787599386.115523:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:10561:x1874433522327552:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 117us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599386.115531:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:1.0:1787599386.120145:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599386.120336:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522327680 00000100:00100000:3.0:1787599386.120347:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522327680 00000100:00100000:3.0:1787599386.120410:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:3.0:1787599386.120422:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c764d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:10561:x1874433522327680:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599386.120440:0:11786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599386.120462:0:11786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07365 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.120496:0:11786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c63a404d/0xa46cbc6741182e3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0735e expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.120506:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599386.120510:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599386.120514:0:11786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 11 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.120544:0:11786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c63a404d/0xa46cbc6741182e3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0735e expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.120553:0:11786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c63a404d/0xa46cbc6741182e3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0735e expref: 11 pid: 6679 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599386.120563:0:11786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11786:1874433543310336:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599386.120672:0:11786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c41377300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599386.126451:0:11786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11786:1874433543310336:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599386.126493:0:11786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 11 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.126515:0:11786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c200, rc 0) 00000100:00100000:1.0:1787599386.126618:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c764d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+11:10561:x1874433522327680:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 6197us (6483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599386.126628:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:1.0:1787599386.128709:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599386.128792:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522327808 00000100:00100000:3.0:1787599386.128802:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522327808 00010000:00010000:3.0:1787599386.128846:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c63a404d/0xa46cbc6741182e3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0735e expref: 11 pid: 6679 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599386.128889:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:3.0:1787599386.128900:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58440850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+11:2359:x1874433522327808:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599386.128915:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599386.128942:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c63a404d/0xa46cbc6741182e3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0735e expref: 11 pid: 6679 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.128957:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c63a404d/0xa46cbc6741182e3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0735e expref: 11 pid: 6679 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.128981:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c63a404d/0xa46cbc6741182e3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0735e expref: 11 pid: 6679 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.128997:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599386.129001:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599386.129010:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 10 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.129029:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 10 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.129093:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 10 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599386.129110:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1874433543310464:192.168.204.30@tcp:105: 00000100:00100000:3.0:1787599386.129915:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c41377300 going to sleep for 11 seconds 00000100:00100000:3.0:1787599386.134109:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1874433543310464:192.168.204.30@tcp:105: 00010000:00010000:3.0:1787599386.134137:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599386.134289:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58440850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:2359:x1874433522327808:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 5389us (5585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599386.134301:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:0.0:1787599386.137596:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599386.137708:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522327936 00000100:00100000:1.0:1787599386.137719:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522327936 00002000:00100000:1.0:1787599386.137771:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9f6c76123b80 x1874433522327936/t0(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:242/0 lens 504/0 e 0 to 0 dl 1787599397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599386.137784:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c76123b80 with x1874433522327936 ext(0->12) 00002000:00010000:1.0:1787599386.137790:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c76123b80 00000100:00100000:1.0:1787599386.137822:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:1.0:1787599386.137833:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:2358:x1874433522327936:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787599386.138390:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:2358:x1874433522327936:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 Request processed in 556us (800us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787599386.138414:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00002000:00100000:0.0:1787599386.138424:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9f6c76123b80 x1874433522327936/t4294967308(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:242/0 lens 504/448 e 0 to 0 dl 1787599397 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787599386.138432:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c76123b80 with x1874433522327936 ext(0->12) 00002000:00010000:0.0:1787599386.138436:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c76123b80 00000100:00100000:0.0:1787599386.144925:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599386.145063:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522328064 00000100:00100000:3.0:1787599386.145074:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522328064 00000100:00100000:3.0:1787599386.145151:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:3.0:1787599386.145196:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:10561:x1874433522328064:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787599386.184260:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787599386.184290:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787599386.184344:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:0.0:1787599386.184407:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787599386.184439:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f6c514d8a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787599386.184445:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c45283b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c514d8180 00000020:00080000:0.0:1787599386.184449:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c45283700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c75dd8400 00000004:00080000:0.0:1787599386.184469:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787599386.184487:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f6c58297900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787599386.184491:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c7586bd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c58297300 00000020:00080000:0.0:1787599386.184494:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c7586bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c76163c00 00000020:00080000:0.0:1787599386.184674:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1787599386.185344:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:10561:x1874433522328064:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 40144us (40421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599386.185370:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 124 00000020:00080000:0.0:1787599386.186436:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787599386.186510:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599386.186533:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543310720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787599386.186602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599386.186618:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599386.186629:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543310592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787599386.186658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599386.186684:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543310848:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787599386.186697:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543310720 00000100:00100000:2.0:1787599386.186704:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543310720 00000100:00100000:1.0:1787599386.186707:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599386.186751:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543310592 00000100:00100000:2.0:1787599386.186755:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543310592 00000100:00100000:1.0:1787599386.186759:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543310848 00000100:00100000:1.0:1787599386.186762:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543310848 00000100:00100000:2.0:1787599386.186769:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599386.186778:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1874433543310720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787599386.186779:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599386.186785:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543310592:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1787599386.186935:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787599386.186939:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787599385 00002000:00010000:2.0:1787599386.186941:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787599386.186943:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787599385 -> 1787599385 00002000:00010000:2.0:1787599386.186945:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787599386.186990:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3300:x1874433543310720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 212us (387us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787599386.186998:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599386.187015:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787599386.187022:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874433543310848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787599386.187040:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1787599386.187067:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c9a17, atime: 0x6a8c9a17, ctime: 0x6a8c9a17, blocks: 0x1 00010000:00010000:2.0:1787599386.187085:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8217f4b/0xa46cbc6741182e49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.187100:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1787599386.187105:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599386.187111:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8217f4b/0xa46cbc6741182e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.187130:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8217f4b/0xa46cbc6741182e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787599386.187138:0:11786:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787599386.187142:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8217f4b/0xa46cbc6741182e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.187150:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8217f4b/0xa46cbc6741182e49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.187152:0:11786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.187189:0:11786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc6741182c0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072c4 expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.187196:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599386.187197:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787599386.187200:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599386.187204:0:11786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.187272:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599386.187279:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8217f4b/0xa46cbc6741182e49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.187287:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:0.0:1787599386.187292:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8217f4b/0xa46cbc6741182e49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.187302:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8217f4b/0xa46cbc6741182e49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.187318:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8217f4b/0xa46cbc6741182e49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.187325:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8217f4b/0xa46cbc6741182e49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.187370:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599386.187372:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599386.187373:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599386.187398:0:11786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc6741182c0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072c4 expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.187417:0:11786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc6741182c0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072c4 expref: 11 pid: 6678 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599386.187435:0:11786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76100380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11786:1874433543310976:192.168.204.30@tcp:104: 00000004:00080000:3.0:1787599386.187530:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c76122300/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787599386.187540:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543310720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787599386.187701:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1874433543310848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 679us (991us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787599386.187709:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787599386.187733:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599386.187737:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787599386.187826:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c76123800/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787599386.187833:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543310848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787599386.187959:0:11786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4814a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599386.189225:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599386.189362:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522328192 00000100:00100000:2.0:1787599386.189373:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522328192 00000100:00100000:2.0:1787599386.189434:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:2.0:1787599386.189446:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:2359:x1874433522328192:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787599386.194367:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599386.194480:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522328320 00000100:00100000:1.0:1787599386.194496:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522328320 00010000:00010000:1.0:1787599386.194552:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc6741182c0b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072c4 expref: 13 pid: 6678 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599386.194604:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:1.0:1787599386.194615:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:2358:x1874433522328320:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599386.194630:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599386.194636:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc6741182c0b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072c4 expref: 13 pid: 6678 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.194653:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc6741182c0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072c4 expref: 13 pid: 6678 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.194702:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599386.194709:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599386.194716:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.194727:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.194768:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599386.194852:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:2358:x1874433522328320:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 237us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599386.194861:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00010000:00010000:1.0:1787599386.194924:0:11786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009219090a/0xa46cbc6741182c0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072c4 expref: 12 pid: 6678 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599386.194940:0:11786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76100380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11786:1874433543310976:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599386.194961:0:11786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.194972:0:11786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.194979:0:11786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.194990:0:11786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.194998:0:11786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.195034:0:11786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787599386.195708:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3301:x1874433543310592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8920us (9046us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787599386.195718:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1787599386.195748:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599386.195756:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787599386.195760:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c76120380/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787599386.195770:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543310592:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787599386.195771:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599386.195778:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.195789:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.195806:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.195813:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000845114f/0xa46cbc6741182e50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.195833:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599386.195835:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599386.195837:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599386.238704:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+11:2359:x1874433522328192:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 49247us (49473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599386.238721:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00000001:00080000:3.0:1787599386.239626:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1787599386.239644:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1787599386.239658:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1787599386.245021:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.245273:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522328576 00000100:00100000:0.0:1787599386.245289:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522328576 00000100:00100000:0.0:1787599386.245380:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:0.0:1787599386.245394:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:10561:x1874433522328576:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599386.245477:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599386.245531:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07357 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.245563:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:0.0:1787599386.245570:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599386.245613:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.245632:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.245643:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599386.246017:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007133ae69 reply state 0000000047b18f63 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599386.246042:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599386.246362:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:10561:x1874433522328576:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 970us (1369us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787599386.246372:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 125 00010000:00010000:3.0:1787599386.254192:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.254219:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.254229:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.254252:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599386.254259:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.254268:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.254291:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:3.0:1787599386.254295:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599386.254301:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.254308:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182e57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599386.255282:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599386.257968:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522328704 00000100:00100000:3.0:1787599386.257991:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522328704 00000100:00100000:3.0:1787599386.258116:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:3.0:1787599386.258131:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522328704:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787599386.258466:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787599386.258704:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787599385 -> 1787599384 00002000:00010000:3.0:1787599386.258708:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787599383 00002000:00010000:3.0:1787599386.258730:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787599385 -> 1787599384 00002000:00010000:3.0:1787599386.258733:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787599386.258832:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2358:x1874433522328704:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 703us (4755us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787599386.258842:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:3.0:1787599386.267484:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.267642:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522328960 00000100:00100000:0.0:1787599386.267724:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522328960 00000100:00100000:0.0:1787599386.267806:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:0.0:1787599386.268377:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:10561:x1874433522328960:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787599386.268484:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.268506:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07349 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.268517:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.268564:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07349 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.268593:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07349 expref: 15 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599386.268611:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543311104:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599386.269538:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58297c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599386.274844:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599386.275602:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543311104:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599386.275645:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599386.276820:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522329088 00000100:00100000:1.0:1787599386.276843:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522329088 00010000:00010000:1.0:1787599386.276907:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07349 expref: 16 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599386.276987:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:1.0:1787599386.276998:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:2358:x1874433522329088:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599386.277030:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599386.277039:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07349 expref: 16 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.277054:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07349 expref: 16 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.277082:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182e18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07349 expref: 16 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.277104:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:1.0:1787599386.277111:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.277123:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.277132:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.277245:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599386.277321:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:2358:x1874433522329088:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 324us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599386.277330:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 55 00010000:00010000:0.0:1787599386.279101:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.279135:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.279225:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.279331:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.279340:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.279346:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599386.279351:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.279359:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.279380:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:0.0:1787599386.279383:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787599386.279389:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.279396:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599386.279797:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:10561:x1874433522328960:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 Request processed in 11424us (12321us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787599386.279810:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:0.0:1787599386.290982:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599386.291108:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522329216 00000100:00100000:1.0:1787599386.291141:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522329216 00000100:00100000:1.0:1787599386.291273:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:1.0:1787599386.291288:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522329216:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787599386.291358:0:11786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.291385:0:11786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.291405:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599386.291411:0:11786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599386.291417:0:11786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.291936:0:11786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 7 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.291962:0:11786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 7 pid: 11786 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599386.291983:0:11786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76100380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11786:1874433543311232:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599386.292222:0:11786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c484d3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599386.307853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.307978:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522329344 00000100:00100000:0.0:1787599386.307992:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522329344 00010000:00010000:0.0:1787599386.308056:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 8 pid: 11786 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599386.308109:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:0.0:1787599386.308122:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522329344:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599386.308142:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599386.308222:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 8 pid: 11786 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.308250:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 8 pid: 11786 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.308284:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599386.308289:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599386.308297:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.308309:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.308337:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599386.308410:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522329344:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 290us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599386.308419:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00010000:00010000:1.0:1787599386.318383:0:11786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9e93a41/0xa46cbc6741182e42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07365 expref: 7 pid: 11786 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599386.318424:0:11786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76100380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11786:1874433543311232:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599386.318491:0:11786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.318622:0:11786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.318633:0:11786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.318686:0:11786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.318695:0:11786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.318706:0:11786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.318714:0:11786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9e00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:0.0:1787599386.318719:0:11786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.318729:0:11786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.318756:0:11786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.318763:0:11786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093c813cd/0xa46cbc6741182e65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599386.318929:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522329216:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 27643us (27961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599386.318941:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:3.0:1787599386.322871:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.323244:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522329600 00000100:00100000:0.0:1787599386.323265:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522329600 00000100:00100000:0.0:1787599386.323358:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:0.0:1787599386.323371:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:10561:x1874433522329600:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787599386.323483:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.323507:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.323523:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.325468:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.325506:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07350 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.325517:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.325578:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07350 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.325623:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07350 expref: 15 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599386.325643:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543311360:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599386.325786:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58297c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599386.337396:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543311360:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599386.337442:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599386.337574:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599386.342884:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522329728 00000100:00100000:1.0:1787599386.342913:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522329728 00010000:00010000:0.0:1787599386.343742:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07350 expref: 16 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599386.343877:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:0.0:1787599386.343891:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:2359:x1874433522329728:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599386.343915:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599386.343925:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07350 expref: 16 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.343942:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07350 expref: 16 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.343975:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741182e26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07350 expref: 16 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.343998:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:0.0:1787599386.344024:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.344036:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.344046:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.344103:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599386.345637:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.345658:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599386.345937:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787599386.346127:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787599386.346209:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787599386.346343:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543311488:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787599386.346516:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:2359:x1874433522329728:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 2623us (8938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599386.346530:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:2.0:1787599386.350421:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599386.350496:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599386.350643:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543311488 00000100:00100000:0.0:1787599386.350655:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543311488 00000100:00100000:0.0:1787599386.350723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599386.350736:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5831:x1874433543311488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787599386.353288:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5831:x1874433543311488:12345-0@lo:1000:mdt00_000.0 Request processed in 2545us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599386.353305:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599386.353619:0:5831:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787599386.353627:0:5831:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1787599386.353653:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c76122300, transno 4294967309 00000100:00100000:1.0:1787599386.353680:0:5831:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9f6c76120380 x1874433543310592/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787599402 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599386.353695:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543311488:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787599386.354415:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787599386.354532:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76100380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543311616:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787599386.354613:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599386.354651:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c484d3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599386.361210:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543311616 00000100:00100000:3.0:1787599386.361245:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543311616 00000100:00100000:3.0:1787599386.361321:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599386.361336:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1874433543311616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787599386.361642:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5831:x1874433543311616:12345-0@lo:1000:mdt00_000.0 Request processed in 309us (7028us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787599386.361650:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599386.361727:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76100380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543311616:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787599386.361786:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361799:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361808:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361832:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fee00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599386.361838:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361848:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361869:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c70860700) 00010000:00010000:3.0:1787599386.361873:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787599386.361878:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361885:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182e73 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361929:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361935:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361940:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361945:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599386.361948:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361953:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361973:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599386.361975:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787599386.361985:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182dbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07334 expref: 18 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.361997:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182dbd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07334 expref: 18 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.362006:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182dbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07334 expref: 18 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.362048:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182dbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07334 expref: 18 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599386.362065:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543311744:192.168.204.30@tcp:105: 00000100:00100000:3.0:1787599386.362220:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58427600 going to sleep for 11 seconds 00000100:00100000:3.0:1787599386.372738:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543311744:192.168.204.30@tcp:105: 00010000:00010000:3.0:1787599386.372785:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372798:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741182db6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372847:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182e7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372866:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182e7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372900:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182e7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372914:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182e7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372921:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182e7a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372928:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182e7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372935:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599386.372939:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182e7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372948:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182e7a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372965:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599386.372968:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599386.372972:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182e7a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372979:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182e7a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372992:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.372998:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.373013:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.373019:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599386.373022:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.373029:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.373038:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599386.373041:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599386.373044:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.373134:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741182e6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599386.373611:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:10561:x1874433522329600:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 50237us (50745us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787599386.373626:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 127 00000020:00080000:3.0:1787599386.373635:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787599386.377030:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.377458:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522329856 00000100:00100000:0.0:1787599386.377473:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522329856 00000100:00100000:0.0:1787599386.377546:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:0.0:1787599386.377560:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:10560:x1874433522329856:12345-192.168.204.30@tcp:49:lfs.0 00000100:00100000:0.0:1787599386.377760:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:10560:x1874433522329856:12345-192.168.204.30@tcp:49:lfs.0 Request processed in 202us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599386.377770:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000040:00080000:1.0:1787599386.382463:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599386.382481:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599386.384787:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787599386.384816:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787599386.389227:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.389537:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522330112 00000100:00100000:0.0:1787599386.389574:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522330112 00000100:00100000:0.0:1787599386.389667:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:0.0:1787599386.389681:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c79450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:10561:x1874433522330112:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787599386.391754:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787599386.391891:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787599386.391997:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.392018:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.392034:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.392043:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599386.393437:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599386.393648:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522330368 00000100:00100000:2.0:1787599386.393666:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522330368 00000100:00100000:2.0:1787599386.393747:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 128 00000100:00100000:2.0:1787599386.393763:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:10560:x1874433522330368:12345-192.168.204.30@tcp:58:lfs.0 00000040:00080000:2.0:1787599386.394718:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787599386.394844:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:10560:x1874433522330368:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 1079us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599386.394855:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 128 00010000:00010000:0.0:1787599386.396195:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.396207:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.396986:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787599386.397192:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c79450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:10561:x1874433522330112:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 7508us (8039us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787599386.397204:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000020:00080000:1.0:1787599386.397211:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787599386.407255:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599386.407622:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.407639:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599386.407671:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.407685:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.407779:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f6c43a07f00) 00010000:00010000:3.0:1787599386.407784:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787599386.407789:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599386.407798:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741182e81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.408726:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599386.408732:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599386.408735:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599386.443595:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599386.443728:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522330496 00000100:00100000:2.0:1787599386.443770:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522330496 00000100:00100000:2.0:1787599386.443857:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:2.0:1787599386.443872:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:10563:x1874433522330496:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599386.443925:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599386.443957:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182e88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0736c expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444059:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182e8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444079:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182e8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444093:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182e8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444112:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182e96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444120:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444127:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444625:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444642:0:8189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0732d expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444653:0:8189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444716:0:8189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0732d expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599386.444735:0:8189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0732d expref: 21 pid: 5831 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599386.444758:0:8189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543311872:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599386.444907:0:8189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599386.449953:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599386.450211:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522330752 00000100:00100000:1.0:1787599386.450236:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522330752 00000100:00100000:1.0:1787599386.450313:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:1.0:1787599386.450350:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:5595:x1874433522330752:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787599386.450704:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:5595:x1874433522330752:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 357us (767us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787599386.450714:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1787599386.450867:0:8189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543311872:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599386.450919:0:8189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599386.464481:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599386.464603:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522330880 00000100:00100000:0.0:1787599386.464618:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522330880 00010000:00010000:0.0:1787599386.464679:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0732d expref: 23 pid: 5831 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599386.464730:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:0.0:1787599386.464743:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76100a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:2357:x1874433522330880:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599386.464783:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599386.464793:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0732d expref: 23 pid: 5831 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.464812:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0732d expref: 23 pid: 5831 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.464840:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182da8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0732d expref: 23 pid: 5831 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.464864:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:0.0:1787599386.464871:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.465651:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.465667:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599386.465704:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599386.465792:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76100a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:2357:x1874433522330880:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 1050us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599386.465803:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00010000:00010000:1.0:1787599386.465974:0:8189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.465984:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599386.466044:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787599386.466050:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599386.466148:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466191:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466203:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182e8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466210:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182e8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466218:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182e8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466454:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599386.466464:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182e8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466499:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182e8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466516:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599386.466520:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599386.466525:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182e8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466532:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618e00/0xa46cbc6741182e8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466550:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466557:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182e96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466563:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466569:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75619000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599386.466572:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466578:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466588:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f6c70382e00) 00010000:00010000:1.0:1787599386.466591:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599386.466595:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182e96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466612:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619000/0xa46cbc6741182e96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466670:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619e00/0xa46cbc6741182e88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0736c expref: 22 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466687:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0736c expref: 21 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599386.466695:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:1.0:1787599386.466698:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599386.466701:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619c00, rc 0) 00000100:00100000:1.0:1787599386.466759:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:10563:x1874433522330496:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 22891us (23180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599386.466768:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 129 00010000:00010000:1.0:1787599386.593505:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599386.659063:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599386.659092:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543312000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599386.659212:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599386.659337:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543312000 00000100:00100000:0.0:1787599386.659350:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543312000 00000100:00100000:0.0:1787599386.659456:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787599386.659468:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874433543312000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599386.659504:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787599386.659575:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874433543312000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599386.659584:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787599386.663027:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543312000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599387.271097:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599387.271148:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599387.271226:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599387.271256:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599387.272007:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522331264 00000100:00100000:2.0:1787599387.272019:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522331264 00000100:00100000:2.0:1787599387.272091:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:2.0:1787599387.272101:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522331264:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599387.272222:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522331008 00000100:00100000:0.0:1787599387.272227:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522331008 00000100:00100000:0.0:1787599387.272448:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 293 00000100:00100000:0.0:1787599387.272459:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2359:x1874433522331008:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599387.273399:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522331264:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 1292us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599387.273411:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:2.0:1787599387.273929:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522331520 00000100:00100000:2.0:1787599387.273936:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522331520 00000100:00100000:2.0:1787599387.273985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522331136 00000100:00100000:2.0:1787599387.273988:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522331136 00000100:00100000:2.0:1787599387.274012:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00100000:2.0:1787599387.274020:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2359:x1874433522331520:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599387.274082:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2359:x1874433522331520:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 62us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599387.274089:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00100000:2.0:1787599387.274104:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00100000:2.0:1787599387.274111:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:2359:x1874433522331136:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599387.274153:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:2359:x1874433522331136:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 42us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599387.274179:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00080000:2.0:1787599387.274333:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599387.276022:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599387.277289:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2359:x1874433522331008:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 4821us (6190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599387.277306:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 293 00000100:00100000:2.0:1787599387.279064:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522331392 00000100:00100000:2.0:1787599387.279082:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522331392 00000100:00100000:2.0:1787599387.279249:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:2.0:1787599387.279272:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522331392:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599387.279372:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522331392:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 110us (3360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599387.279381:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00080000:0.0:1787599387.284375:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1787599387.425413:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599387.425422:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599387.425455:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787599387.425462:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787599387.425667:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76101180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543312128:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787599387.426020:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c484d3840 going to sleep for 11 seconds 00000100:00100000:3.0:1787599387.444135:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599387.444194:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522331648 00000100:00100000:3.0:1787599387.444205:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522331648 00000100:00100000:3.0:1787599387.444321:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:3.0:1787599387.444332:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:10574:x1874433522331648:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787599387.444384:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787599387.444500:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:10574:x1874433522331648:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 169us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599387.444509:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:2.0:1787599387.450353:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76101180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543312128:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787599387.456406:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599387.458054:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522331904 00000100:00100000:3.0:1787599387.458069:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522331904 00000100:00100000:3.0:1787599387.458145:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:3.0:1787599387.458178:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:10574:x1874433522331904:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599387.458199:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599387.458243:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ea4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07373 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.458353:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182eab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.458368:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.458381:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599387.458394:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787599387.458534:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ea4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07373 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.458553:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182eab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07373 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.458561:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599387.458565:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599387.458568:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c600, rc 0) 00000100:00100000:3.0:1787599387.458635:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:10574:x1874433522331904:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 480us (2237us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787599387.458642:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:3.0:1787599387.483360:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599387.483403:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599387.483438:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522332160 00000100:00100000:3.0:1787599387.483451:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522332160 00000100:00100000:3.0:1787599387.483510:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:3.0:1787599387.483531:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:10574:x1874433522332160:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787599387.484412:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522332288 00000100:00100000:0.0:1787599387.484424:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522332288 00000100:00100000:0.0:1787599387.484476:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:0.0:1787599387.484485:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:2357:x1874433522332288:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599387.484497:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599387.484521:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182eab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07373 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599387.484540:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:0.0:1787599387.484545:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599387.484613:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:2357:x1874433522332288:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 129us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599387.484629:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00010000:00010000:3.0:1787599387.487356:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.487382:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.487394:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.487593:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.487601:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.487607:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.487613:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599387.487618:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.487625:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.487637:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599387.487639:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599387.487644:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.487649:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599387.488141:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:10574:x1874433522332160:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 4607us (4789us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787599387.488152:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 132 00000040:00080000:2.0:1787599387.488358:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599387.488362:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599387.493007:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787599387.493024:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787599387.495961:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599387.495970:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599387.496016:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787599387.496022:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787599387.499602:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599387.499676:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522332544 00000100:00100000:1.0:1787599387.499686:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522332544 00000100:00100000:1.0:1787599387.499742:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:1.0:1787599387.499753:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:10574:x1874433522332544:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787599387.500009:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:10574:x1874433522332544:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 257us (413us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787599387.500017:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00010000:00010000:2.0:1787599387.617777:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599387.708716:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599387.710514:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522332800 00000100:00100000:3.0:1787599387.710530:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522332800 00000100:00100000:3.0:1787599387.710585:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:3.0:1787599387.710595:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:10587:x1874433522332800:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599387.710618:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599387.710639:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ec0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0737a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.710741:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182ec7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.710755:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182ec7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.710768:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182ec7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599387.710780:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787599387.710915:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ec0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0737a expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.710932:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0737a expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.710958:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599387.710961:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787599387.710965:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c600, rc 0) 00000100:00100000:3.0:1787599387.711040:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:10587:x1874433522332800:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 446us (2336us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787599387.711048:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:2.0:1787599387.723870:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599387.725349:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522332928 00000100:00100000:3.0:1787599387.725365:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522332928 00000100:00100000:3.0:1787599387.725438:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:3.0:1787599387.725597:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:10587:x1874433522332928:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1787599387.725672:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.725690:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.725699:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.725724:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.725729:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.725736:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.725741:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599387.725758:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.725766:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.725778:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599387.725782:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599387.725786:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ed5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599387.725794:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182ed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599387.725878:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:10587:x1874433522332928:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 286us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599387.725886:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:0.0:1787599387.860543:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599387.860660:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522333056 00000100:00100000:2.0:1787599387.860672:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522333056 00000100:00100000:2.0:1787599387.860762:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:2.0:1787599387.860774:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522333056:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:2.0:1787599387.860794:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599387.860816:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b0dc47f/0xa46cbc6741182edc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07381 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599387.860847:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c9a18, atime: 0x6a8c9a17, ctime: 0x6a8c9a18, blocks: 0xb 00010000:00010000:2.0:1787599387.860867:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1787599387.860871:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599387.860881:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b0dc47f/0xa46cbc6741182edc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07381 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599387.860900:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b0dc47f/0xa46cbc6741182edc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07381 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599387.860913:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75619400, rc 0) 00000100:00100000:2.0:1787599387.860979:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2357:x1874433522333056:12345-192.168.204.30@tcp:101:cat.0 Request processed in 208us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599387.860986:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:1.0:1787599387.865500:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599387.865611:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522333184 00000100:00100000:0.0:1787599387.865622:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522333184 00002000:00100000:0.0:1787599387.865673:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9f6c74f85880 x1874433522333184/t0(0) o3->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:243/0 lens 488/0 e 0 to 0 dl 1787599398 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787599387.865819:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c74f85880 with x1874433522333184 ext(0->4095) 00002000:00010000:0.0:1787599387.865825:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c74f85880 00000100:00100000:0.0:1787599387.865861:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:0.0:1787599387.865872:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2356:x1874433522333184:12345-192.168.204.30@tcp:3:cat.0 00000100:00100000:0.0:1787599387.866217:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2356:x1874433522333184:12345-192.168.204.30@tcp:3:cat.0 Request processed in 347us (726us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787599387.866227:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00002000:00100000:0.0:1787599387.866235:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9f6c74f85880 x1874433522333184/t0(0) o3->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:243/0 lens 488/4536 e 0 to 0 dl 1787599398 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787599387.866244:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c74f85880 with x1874433522333184 ext(0->4095) 00002000:00010000:0.0:1787599387.866248:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c74f85880 00010000:00010000:1.0:1787599388.642623:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599388.707687:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543312256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599388.707821:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599388.708340:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543312256 00000100:00100000:3.0:1787599388.708353:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543312256 00000100:00080000:0.0:1787599388.708398:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599388.708429:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787599388.708438:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787599388.708445:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874433543312256:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599388.708451:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787599388.708502:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599388.708720:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874433543312256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 280us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599388.708729:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787599388.708921:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543312256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599388.713732:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543312640:0@lo:400:kworker.0 00000100:00100000:0.0:1787599388.713827:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599388.714198:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543312512:0@lo:400:kworker.0 00000100:00100000:2.0:1787599388.714232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599388.714274:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599388.714281:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543312384:0@lo:400:kworker.0 00000100:00100000:2.0:1787599388.714312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599388.714489:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599388.714497:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543312768:0@lo:400:kworker.0 00000100:00100000:0.0:1787599388.714528:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599388.714576:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543312640 00000100:00100000:0.0:1787599388.714583:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543312640 00000100:00100000:0.0:1787599388.714633:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543312512 00000100:00100000:0.0:1787599388.714647:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543312512 00000100:00100000:0.0:1787599388.714671:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787599388.714688:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543312640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599388.714988:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543312768 00000100:00100000:2.0:1787599388.714993:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543312768 00000100:00100000:2.0:1787599388.715038:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787599388.715046:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543312768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599388.715150:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787599388.715197:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543312512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599388.715335:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599388.715346:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543312896:0@lo:400:kworker.0 00000100:00100000:2.0:1787599388.716038:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543312768:12345-0@lo:400:kworker.0 Request processed in 988us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599388.716049:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787599388.716121:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543312384 00000100:00100000:2.0:1787599388.716127:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543312384 00000100:00100000:2.0:1787599388.716205:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787599388.716213:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543312384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599388.716252:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543312384:12345-0@lo:400:kworker.0 Request processed in 40us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599388.716271:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1787599388.716420:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599388.716426:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599388.717971:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543312640:12345-0@lo:400:kworker.0 Request processed in 3284us (4135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599388.717985:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787599388.718078:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543312768:0@lo:400:kworker.0 00000100:00100000:0.0:1787599388.718092:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543312640:0@lo:400:kworker.0 00000100:00100000:3.0:1787599388.719805:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543312512:12345-0@lo:400:kworker.0 Request processed in 4613us (5562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599388.719852:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787599388.730367:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599388.730442:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543312384:0@lo:400:kworker.0 00000100:00100000:1.0:1787599388.730462:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543312512:0@lo:400:kworker.0 00000100:00100000:3.0:1787599388.733091:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543312896 00000100:00100000:3.0:1787599388.733108:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543312896 00000100:00100000:3.0:1787599388.733254:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787599388.733266:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543312896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599388.733369:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543312896:12345-0@lo:400:kworker.0 Request processed in 105us (3008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599388.733376:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1787599388.733666:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599388.734075:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543312896:0@lo:400:kworker.0 00010000:00010000:2.0:1787599389.666323:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787599389.844811:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1787599389.844858:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787599389.844865:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:3.0:1787599390.689588:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787599391.343222:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000020:00080000:2.0:1787599391.343250:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1787599391.343266:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1787599391.343282:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f6c484d3240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787599391.343288:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c412ac900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c484d3e40 00000020:00080000:2.0:1787599391.343292:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c412ac300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c76160000 00000001:00080000:2.0:1787599391.343308:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787599391.343459:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787599391.343773:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1787599391.366687:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787599391.366713:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1787599391.366718:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:2.0:1787599391.715350:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599391.778440:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599391.778474:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543313024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599391.778573:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599391.778725:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543313024 00000100:00100000:0.0:1787599391.778745:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543313024 00000100:00100000:0.0:1787599391.778843:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787599391.778857:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543313024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599391.778917:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787599391.779028:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599391.779209:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787599391.779217:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c76120380, transno 4294967310 00000004:00080000:3.0:1787599391.779233:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787599391.779276:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543313024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599391.780090:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543313024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1230us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599391.780106:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787599392.389882:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599392.389955:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599392.389990:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599392.390016:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599392.390045:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599392.390046:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522333312 00000100:00100000:0.0:1787599392.390062:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522333312 00000100:00100000:3.0:1787599392.390075:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522333568 00000100:00100000:3.0:1787599392.390082:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522333568 00000100:00100000:0.0:1787599392.390147:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 295 00000100:00100000:3.0:1787599392.390149:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522333696 00000100:00100000:3.0:1787599392.390181:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522333696 00000100:00100000:0.0:1787599392.390184:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522333312:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599392.390218:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:3.0:1787599392.390229:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522333568:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599392.390282:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522333568:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 57us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599392.390288:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522333312:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 127us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599392.390294:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:0.0:1787599392.390307:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 295 00000100:00100000:3.0:1787599392.390320:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:3.0:1787599392.390329:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522333696:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599392.390356:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522333696:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599392.390362:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:3.0:1787599392.390382:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522333824 00000100:00100000:3.0:1787599392.390386:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522333824 00000100:00100000:3.0:1787599392.390413:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522333440 00000100:00100000:3.0:1787599392.390416:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522333440 00000100:00100000:3.0:1787599392.390438:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:3.0:1787599392.390446:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522333824:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599392.390476:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522333824:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 31us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599392.390483:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:3.0:1787599392.390495:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:3.0:1787599392.390501:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:2358:x1874433522333440:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599392.390524:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:2358:x1874433522333440:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599392.390530:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00080000:3.0:1787599392.390564:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599392.390569:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599392.390572:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787599392.610390:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599392.610407:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599392.610455:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787599392.610464:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787599392.739601:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599392.962513:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599392.962630:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522333952 00000100:00100000:3.0:1787599392.962661:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522333952 00000100:00100000:3.0:1787599392.962757:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:3.0:1787599392.962771:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:10241:x1874433522333952:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787599392.963019:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:10241:x1874433522333952:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 Request processed in 249us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599392.963028:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:3.0:1787599392.967330:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599392.967506:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522334208 00000100:00100000:1.0:1787599392.967520:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522334208 00000100:00100000:1.0:1787599392.967672:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:1.0:1787599392.967686:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:10241:x1874433522334208:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787599392.968453:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:10241:x1874433522334208:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 765us (1308us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787599392.968467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:1.0:1787599393.417238:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599393.417425:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522334336 00000100:00100000:3.0:1787599393.417439:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522334336 00000100:00100000:3.0:1787599393.417532:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 136 00000100:00100000:3.0:1787599393.417546:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:11039:x1874433522334336:12345-192.168.204.30@tcp:101:lsof.0 00010000:00010000:3.0:1787599393.417576:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599393.417605:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ee3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07388 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599393.417689:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599393.417706:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599393.417719:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599393.417986:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787599393.418000:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599393.418138:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599393.418209:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ee3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07388 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599393.418234:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07388 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599393.418245:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:3.0:1787599393.418248:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599393.418253:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d200, rc 0) 00000100:00100000:3.0:1787599393.418357:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:11039:x1874433522334336:12345-192.168.204.30@tcp:101:lsof.0 Request processed in 813us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599393.418365:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 136 00010000:00010000:2.0:1787599393.761551:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599393.825780:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543313280:0@lo:400:kworker.0 00000100:00100000:0.0:1787599393.825834:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543313152:0@lo:400:kworker.0 00000100:00100000:1.0:1787599393.825958:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543313408:0@lo:400:kworker.0 00000100:00100000:3.0:1787599393.826055:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543313536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599393.827314:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599393.830651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599393.830740:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543313152 00000100:00100000:0.0:1787599393.830754:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543313152 00000100:00100000:0.0:1787599393.830821:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787599393.830849:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543313152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599393.830945:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543313152:12345-0@lo:400:kworker.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599393.830948:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f2d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543313792:0@lo:400:kworker.0 00000100:00100000:0.0:1787599393.830955:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787599393.831009:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599393.831034:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543313152:0@lo:400:kworker.0 00000100:00100000:2.0:1787599393.831039:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599393.831049:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543313664:0@lo:400:kworker.0 00000100:00100000:2.0:1787599393.831082:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599393.831097:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543313280 00000100:00100000:0.0:1787599393.831103:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543313280 00000100:00100000:2.0:1787599393.831139:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543313664 00000100:00100000:0.0:1787599393.831141:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543313792 00000100:00100000:2.0:1787599393.831146:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543313664 00000100:00100000:0.0:1787599393.831147:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543313792 00000100:00100000:2.0:1787599393.831210:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787599393.831218:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543313664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599393.831260:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543313664:12345-0@lo:400:kworker.0 Request processed in 43us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599393.831266:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787599393.831400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599393.831608:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543313408 00000100:00100000:0.0:1787599393.831613:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543313408 00000100:00100000:0.0:1787599393.831700:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787599393.831708:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543313280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599393.831750:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543313280:12345-0@lo:400:kworker.0 Request processed in 43us (4445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599393.831757:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787599393.831769:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787599393.831776:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543313792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599393.831805:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543313792:12345-0@lo:400:kworker.0 Request processed in 30us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599393.831993:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787599393.832009:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787599393.832016:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543313408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599393.832049:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543313408:12345-0@lo:400:kworker.0 Request processed in 35us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599393.832055:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787599393.832191:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543313664:0@lo:400:kworker.0 00000100:00100000:0.0:1787599393.832207:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f2d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543313792:0@lo:400:kworker.0 00000100:00100000:0.0:1787599393.832218:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543313280:0@lo:400:kworker.0 00000100:00080000:2.0:1787599393.832415:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599393.832421:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599393.832867:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543313408:0@lo:400:kworker.0 00000100:00100000:1.0:1787599393.833040:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f2d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543313920:0@lo:400:kworker.0 00000100:00100000:1.0:1787599393.833109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599393.833634:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543313920 00000100:00100000:2.0:1787599393.833643:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543313920 00000100:00100000:2.0:1787599393.833741:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787599393.833752:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543313920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599393.833824:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543313920:12345-0@lo:400:kworker.0 Request processed in 74us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599393.833832:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787599393.834035:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599393.834056:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787599393.834065:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787599393.834119:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c76123800, transno 4294967304 00000100:00100000:1.0:1787599393.834143:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f2d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543313920:0@lo:400:kworker.0 00000100:00100000:3.0:1787599393.836375:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599393.838801:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543313536 00000100:00100000:0.0:1787599393.838825:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543313536 00000100:00100000:0.0:1787599393.838996:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787599393.839011:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543313536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599393.839067:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599393.839229:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543313536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (2880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599393.839237:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787599393.840333:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543313536:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787599394.785451:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599395.810220:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787599396.452237:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787599396.452261:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787599396.452304:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787599396.452326:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787599396.834342:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599396.898495:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543314048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599396.898620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599396.898822:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543314048 00000100:00100000:0.0:1787599396.898834:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543314048 00000100:00100000:0.0:1787599396.898920:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787599396.898934:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543314048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599396.899002:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599396.899078:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543314048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599396.899085:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787599396.899309:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599396.899361:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543314048:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787599397.117498:0:12291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:23:14 (1787599394) 00000100:00100000:0.0:1787599397.519821:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599397.519866:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599397.519898:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599397.519924:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599397.519951:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599397.519979:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522334976 00000100:00100000:0.0:1787599397.519989:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522334976 00000100:00100000:0.0:1787599397.520058:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522334592 00000100:00100000:0.0:1787599397.520061:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522334592 00000100:00100000:0.0:1787599397.520089:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:0.0:1787599397.520098:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2357:x1874433522334976:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599397.520298:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522334720 00000100:00100000:3.0:1787599397.520303:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522334720 00000100:00100000:3.0:1787599397.520334:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522334848 00000100:00100000:3.0:1787599397.520337:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522334848 00000100:00100000:3.0:1787599397.520358:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:3.0:1787599397.520365:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522334720:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599397.520417:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522334720:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 53us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599397.520440:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:3.0:1787599397.520473:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:3.0:1787599397.520480:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522334848:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599397.520504:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522334848:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599397.520509:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00080000:3.0:1787599397.520644:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599397.520649:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599397.520651:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599397.520672:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:3.0:1787599397.520680:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:2357:x1874433522334592:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599397.520715:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:2357:x1874433522334592:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 36us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599397.520722:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:2.0:1787599397.522009:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522334464 00000100:00100000:2.0:1787599397.522030:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522334464 00000100:00100000:2.0:1787599397.522081:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 297 00000100:00100000:2.0:1787599397.522091:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522334464:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599397.522182:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522334464:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 92us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599397.522192:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 297 00000100:00100000:3.0:1787599397.525579:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2357:x1874433522334976:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 5467us (5665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599397.525596:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 152 00010000:00010000:2.0:1787599397.857572:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599398.588464:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599398.588628:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522335232 00000100:00100000:3.0:1787599398.588647:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522335232 00000100:00100000:3.0:1787599398.588742:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:3.0:1787599398.588757:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:11305:x1874433522335232:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599398.588915:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599398.588946:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182ef1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0738f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.589147:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ef8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.589331:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.589347:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.589366:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182eff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.589373:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.589379:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.592456:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182f06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.592488:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182f06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.592502:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182f06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599398.592525:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787599398.592960:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.592971:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ef8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.592988:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593007:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599398.593012:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593021:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ef8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593038:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f6c50836d00) 00010000:00010000:3.0:1787599398.593042:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599398.593048:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ef8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593054:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182ef8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593072:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182eff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593078:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182eff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593084:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182eff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593090:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599398.593093:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182eff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593110:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182eff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593119:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f6c70860e00) 00010000:00010000:3.0:1787599398.593122:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599398.593125:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182eff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.593131:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182eff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.600621:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182ef1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0738f expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.600661:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182f06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0738f expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599398.600674:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:3.0:1787599398.600677:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599398.600681:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d800, rc 0) 00000100:00100000:3.0:1787599398.600802:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:11305:x1874433522335232:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 12048us (12350us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787599398.600814:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:1.0:1787599398.605879:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599398.606048:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599398.606181:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522335488 00000100:00100000:2.0:1787599398.606195:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522335488 00000100:00100000:2.0:1787599398.606273:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:2.0:1787599398.606286:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:11305:x1874433522335488:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787599398.606447:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:11305:x1874433522335488:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 163us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599398.606455:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:0.0:1787599398.607252:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522335360 00000100:00100000:0.0:1787599398.607323:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522335360 00000100:00100000:0.0:1787599398.607437:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:0.0:1787599398.607448:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58441050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:2356:x1874433522335360:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599398.607464:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599398.607500:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741182f06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0738f expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599398.607526:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:0.0:1787599398.607532:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599398.607598:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58441050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:2356:x1874433522335360:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 143us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599398.607625:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000040:00080000:1.0:1787599398.753529:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599398.753545:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599398.754059:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787599398.754071:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787599398.881443:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599398.946394:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543314432:0@lo:400:kworker.0 00000100:00100000:2.0:1787599398.946511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599398.946597:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599398.946604:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543314560:0@lo:400:kworker.0 00000100:00100000:2.0:1787599398.946636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599398.949625:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543314560 00000100:00100000:3.0:1787599398.949723:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543314560 00000100:00100000:3.0:1787599398.950015:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787599398.950029:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543314560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599398.950197:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543314560:12345-0@lo:400:kworker.0 Request processed in 172us (3559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599398.950223:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787599398.950376:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543314560:0@lo:400:kworker.0 00000100:00100000:3.0:1787599398.950518:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543314304:0@lo:400:kworker.0 00000100:00100000:3.0:1787599398.950567:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599398.950597:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543314816:0@lo:400:kworker.0 00000100:00100000:3.0:1787599398.950623:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599398.950740:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787599398.950749:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543314176:0@lo:400:kworker.0 00000100:00100000:3.0:1787599398.950783:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599398.950894:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543314688:0@lo:400:kworker.0 00000100:00100000:3.0:1787599398.950919:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599398.950954:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543314432 00000100:00100000:3.0:1787599398.950960:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543314432 00000100:00100000:3.0:1787599398.951011:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543314304 00000100:00100000:3.0:1787599398.951014:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543314304 00000100:00100000:3.0:1787599398.951029:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543314688 00000100:00100000:3.0:1787599398.951032:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543314688 00000100:00100000:3.0:1787599398.951050:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787599398.951058:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543314432:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787599398.951138:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599398.951144:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599398.951183:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787599398.951193:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543314304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599398.951243:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543314304:12345-0@lo:400:kworker.0 Request processed in 53us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599398.951249:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787599398.951267:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787599398.951273:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543314688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599398.951317:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543314688:12345-0@lo:400:kworker.0 Request processed in 43us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599398.951323:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787599398.951538:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543314432:12345-0@lo:400:kworker.0 Request processed in 480us (5027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599398.951546:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787599398.951569:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543314816 00000100:00100000:3.0:1787599398.951573:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543314816 00000100:00100000:3.0:1787599398.951610:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787599398.951617:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543314816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599398.951735:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543314816:12345-0@lo:400:kworker.0 Request processed in 118us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599398.951742:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787599398.951857:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543314176 00000100:00100000:0.0:1787599398.951864:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543314176 00000100:00100000:3.0:1787599398.951881:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543314688:0@lo:400:kworker.0 00000100:00100000:3.0:1787599398.951901:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543314304:0@lo:400:kworker.0 00000100:00100000:0.0:1787599398.951907:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787599398.951916:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543314816:0@lo:400:kworker.0 00000100:00100000:0.0:1787599398.951919:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543314176:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787599398.952218:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599398.952244:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543314432:0@lo:400:kworker.0 00000100:00100000:0.0:1787599398.952881:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543314176:12345-0@lo:400:kworker.0 Request processed in 962us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599398.952892:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787599398.953018:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543314176:0@lo:400:kworker.0 00000100:00100000:2.0:1787599398.953282:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599398.953297:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c483b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543314944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599398.953343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599398.953391:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543314944 00000100:00100000:2.0:1787599398.953398:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543314944 00000100:00100000:2.0:1787599398.953446:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599398.953457:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543314944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599398.953499:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599398.953558:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543314944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599398.953565:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787599398.953600:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c483b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543314944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787599399.906446:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599400.943331:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599401.016514:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599401.016802:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522335616 00000100:00100000:2.0:1787599401.016826:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522335616 00000100:00100000:2.0:1787599401.016928:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:2.0:1787599401.016943:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:11348:x1874433522335616:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599401.017033:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599401.017063:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741182f14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07396 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017149:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741182f1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017210:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741182f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787599401.017386:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787599401.017498:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741182f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017521:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182f22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017529:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017535:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017896:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741182f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017906:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741182f1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017916:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741182f1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017923:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030a00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599401.017929:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741182f1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017936:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741182f1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017962:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:2.0:1787599401.017973:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599401.017980:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741182f1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.017987:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741182f1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.018008:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.018014:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182f22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.018020:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182f22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.018025:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599401.018027:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182f22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.018033:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182f22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.018041:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f6c70382000) 00010000:00010000:2.0:1787599401.018044:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599401.018047:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182f22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.018053:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182f22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.018104:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741182f14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07396 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.018130:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:2.0:1787599401.018132:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599401.018136:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741182f14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07396 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.018147:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031c00, rc 0) 00000100:00100000:2.0:1787599401.019485:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:11348:x1874433522335616:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2532us (2973us total) trans 0 rc 301/301 00000100:00100000:2.0:1787599401.019500:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:1.0:1787599401.029462:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599401.030346:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522335872 00000100:00100000:2.0:1787599401.030361:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522335872 00000100:00100000:2.0:1787599401.030441:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:2.0:1787599401.030453:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:11348:x1874433522335872:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:2.0:1787599401.030533:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599401.030573:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619600/0xa46cbc6741182892 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071cf expref: 14 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.030611:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:2.0:1787599401.030617:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599401.031691:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.031720:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07388 expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.032311:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.032382:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07388 expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.032402:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07388 expref: 5 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599401.032424:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543315072:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599401.032562:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7660a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599401.037372:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599401.037651:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543315072:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599401.037689:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599401.038051:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522336000 00000100:00100000:0.0:1787599401.038062:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522336000 00010000:00010000:0.0:1787599401.038140:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07388 expref: 6 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599401.038215:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:0.0:1787599401.038236:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2358:x1874433522336000:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599401.038253:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599401.038260:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07388 expref: 6 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.038275:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07388 expref: 6 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.038304:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182eea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07388 expref: 6 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.038345:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:0.0:1787599401.038351:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.038361:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.038370:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.038400:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599401.038472:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2358:x1874433522336000:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 237us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599401.038480:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00010000:00010000:0.0:1787599401.038645:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.038653:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.038682:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.038694:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.038702:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787599401.039487:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787599401.045057:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787599401.045096:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.045110:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.045119:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.045127:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599401.045133:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.045142:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.045197:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c70382400) 00010000:00010000:0.0:1787599401.045202:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599401.045208:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.045214:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741182f29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599401.045244:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0e2e8fe reply state 00000000adbd001c transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599401.045256:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599401.045411:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:11348:x1874433522335872:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 14953us (15956us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787599401.045421:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 140 00010000:00010000:3.0:1787599401.051362:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.051389:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.051398:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.051404:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599401.051411:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.051420:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.051443:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f6c43a07200) 00010000:00010000:3.0:1787599401.051447:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599401.051453:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.051461:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f30 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599401.142627:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599401.142693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522336128 00000100:00100000:0.0:1787599401.142708:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522336128 00000100:00100000:0.0:1787599401.142781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:0.0:1787599401.142793:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:11356:x1874433522336128:12345-192.168.204.30@tcp:101:lctl.0 00010000:00010000:0.0:1787599401.142843:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599401.142881:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0739d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.142982:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182f3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.143000:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.143013:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599401.143099:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787599401.143104:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599401.143141:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.143197:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0739d expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.143231:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182f3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0739d expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.143241:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599401.143245:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599401.143257:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff800, rc 0) 00000100:00100000:0.0:1787599401.149195:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:11356:x1874433522336128:12345-192.168.204.30@tcp:101:lctl.0 Request processed in 4982us (5162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599401.149228:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:0.0:1787599401.249360:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599401.249474:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522336256 00000100:00100000:3.0:1787599401.249487:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522336256 00000100:00100000:3.0:1787599401.249584:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00100000:3.0:1787599401.249597:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+15:11362:x1874433522336256:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1787599401.249625:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599401.249663:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182f45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073a4 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.249753:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182f4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.249770:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182f4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.249783:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182f4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.249799:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182f53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.249806:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.249812:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.249956:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182f5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.249964:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.249991:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599401.250034:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787599401.250039:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599401.250067:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250081:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182f4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250087:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182f4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250096:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182f4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250102:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599401.250107:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182f4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250116:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182f4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250130:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:3.0:1787599401.250134:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599401.250139:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182f4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250147:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182f4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250222:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250229:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182f53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250235:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182f53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250239:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599401.250242:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182f53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250248:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182f53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250256:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f6c70860f00) 00010000:00010000:3.0:1787599401.250258:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599401.250261:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182f53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250267:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741182f53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250301:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073a4 expref: 17 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250316:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182f5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073a4 expref: 16 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.250336:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599401.250338:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787599401.250341:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24de00, rc 0) 00000100:00100000:3.0:1787599401.250433:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:11362:x1874433522336256:12345-192.168.204.30@tcp:101:bash.0 Request processed in 838us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599401.250442:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00100000:1.0:1787599401.257589:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599401.257687:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522336512 00000100:00100000:0.0:1787599401.257701:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522336512 00000100:00100000:0.0:1787599401.257783:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00100000:0.0:1787599401.257796:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+16:11362:x1874433522336512:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599401.257826:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599401.257865:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073ab expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.258077:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182f68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.258095:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182f68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.258110:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182f68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.260550:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.260582:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.260625:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599401.262207:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787599401.262491:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262510:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262523:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262576:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182f68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262584:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182f68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262594:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182f68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262601:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599401.262607:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182f68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262617:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182f68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262634:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:1.0:1787599401.262638:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599401.262657:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182f68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262665:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc6741182f68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599401.262685:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064375db6 reply state 0000000087fb72a3 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599401.262698:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787599401.262768:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741182f61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ab expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262787:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ab expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.262796:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836300) 00010000:00010000:1.0:1787599401.262799:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599401.262802:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8400, rc 0) 00000100:00100000:1.0:1787599401.262925:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:11362:x1874433522336512:12345-192.168.204.30@tcp:101:bash.0 Request processed in 5131us (5350us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787599401.262937:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 143 00010000:00010000:3.0:1787599401.267096:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.267121:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.267131:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.267139:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8a00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599401.267146:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.267180:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.267206:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c50836b00) 00010000:00010000:3.0:1787599401.267209:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599401.267225:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.267232:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc6741182f6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599401.272973:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599401.274086:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522336640 00000100:00100000:3.0:1787599401.274110:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522336640 00000100:00100000:3.0:1787599401.274550:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:3.0:1787599401.274567:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2358:x1874433522336640:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1787599401.274597:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599401.274629:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182f84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073b2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787599401.274667:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599401.274697:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1787599401.274702:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599401.274715:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b2 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.274750:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b2 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.274768:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c200, rc 0) 00000100:00100000:3.0:1787599401.274874:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522336640:12345-192.168.204.30@tcp:101:bash.0 Request processed in 311us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599401.274883:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00080000:1.0:1787599401.276698:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599401.286055:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599401.286703:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522336768 00000100:00100000:3.0:1787599401.286793:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522336768 00000100:00100000:3.0:1787599401.287049:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:3.0:1787599401.287065:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:11362:x1874433522336768:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1787599401.287113:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599401.287139:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073b9 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.287625:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182f84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b2 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.287640:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599401.287645:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599401.287653:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.287706:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182f84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b2 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.287802:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182f84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b2 expref: 7 pid: 6677 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599401.287823:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f2d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874433543315200:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599401.288620:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787599401.295132:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599401.295762:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522336896 00000100:00100000:0.0:1787599401.295777:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522336896 00010000:00010000:0.0:1787599401.295843:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182f84 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b2 expref: 8 pid: 6677 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599401.295906:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:0.0:1787599401.295921:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522336896:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599401.295977:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599401.296012:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182f84 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b2 expref: 8 pid: 6677 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.296031:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182f84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b2 expref: 8 pid: 6677 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.296066:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599401.296072:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599401.296084:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.296097:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.296153:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599401.296200:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76100a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5816:1874433543315328:192.168.204.30@tcp:105: 00000100:00100000:0.0:1787599401.296575:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d8180 going to sleep for 11 seconds 00010000:00010000:3.0:1787599401.296889:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182f84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b2 expref: 8 pid: 6677 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599401.296911:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f2d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874433543315200:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599401.296957:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.296984:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d600, rc 0) 00000100:00100000:3.0:1787599401.297025:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:11362:x1874433522336768:12345-192.168.204.30@tcp:101:bash.0 Request processed in 9964us (10984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599401.297035:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:0.0:1787599401.303259:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76100a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5816:1874433543315328:192.168.204.30@tcp:105: 00010000:00010000:0.0:1787599401.303311:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599401.303399:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522336896:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 7480us (8284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599401.303414:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:2.0:1787599401.311432:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599401.311573:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522337152 00000100:00100000:1.0:1787599401.311587:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522337152 00000100:00100000:1.0:1787599401.311665:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:1.0:1787599401.311679:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:11362:x1874433522337152:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:0.0:1787599401.312657:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:11362:x1874433522337152:12345-192.168.204.30@tcp:35:bash.0 Request processed in 971us (1368us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787599401.312672:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:2.0:1787599401.425558:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599401.426244:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522337408 00000100:00100000:0.0:1787599401.426259:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522337408 00000100:00100000:0.0:1787599401.426342:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:0.0:1787599401.426355:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:11372:x1874433522337408:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599401.426392:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599401.426423:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182f92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073c0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599401.426593:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787599401.426777:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182f92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073c0 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.426796:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599401.426799:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599401.426805:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741182f92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073c0 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.426823:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fee00, rc 0) 00000100:00100000:0.0:1787599401.426932:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:11372:x1874433522337408:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 579us (1391us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787599401.426950:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:2.0:1787599401.439441:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599401.440003:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522337664 00000100:00100000:1.0:1787599401.440038:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522337664 00000100:00100000:1.0:1787599401.440179:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:1.0:1787599401.440193:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:11372:x1874433522337664:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1787599401.440555:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:11372:x1874433522337664:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 364us (1129us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787599401.440565:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:0.0:1787599401.533717:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599401.533795:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522337792 00000100:00100000:3.0:1787599401.533809:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522337792 00000100:00100000:3.0:1787599401.533896:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:3.0:1787599401.533911:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:11378:x1874433522337792:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599401.533957:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599401.533996:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182fa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.534092:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182fa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.534109:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.534123:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599401.534458:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787599401.534463:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599401.535098:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.535148:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182fa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073c7 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.535888:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073c7 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.535899:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599401.535902:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599401.535907:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d000, rc 0) 00000100:00100000:3.0:1787599401.536031:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:11378:x1874433522337792:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2121us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599401.536042:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:2.0:1787599401.542239:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599401.542294:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522338048 00000100:00100000:2.0:1787599401.542307:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522338048 00000100:00100000:2.0:1787599401.543288:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 146 00000100:00100000:2.0:1787599401.543305:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:11378:x1874433522338048:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599401.543347:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599401.543380:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741182fae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073ce expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.543574:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741182fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.543594:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741182fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.543608:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741182fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599401.543624:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787599401.544345:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741182fae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ce expref: 25 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.544377:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741182fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ce expref: 24 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.544389:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836300) 00010000:00010000:3.0:1787599401.544392:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599401.544396:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031200, rc 0) 00000100:00100000:2.0:1787599401.546320:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:11378:x1874433522338048:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 3002us (4092us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787599401.546841:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 146 00000100:00100000:2.0:1787599401.553102:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599401.553197:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599401.554815:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522338304 00000100:00100000:3.0:1787599401.554837:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522338304 00000100:00100000:3.0:1787599401.554947:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:3.0:1787599401.554962:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:11378:x1874433522338304:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599401.555007:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599401.555041:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182fc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073d5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.555253:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182fca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.555271:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182fca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.555284:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182fca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599401.555299:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:0.0:1787599401.555529:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522338432 00000100:00100000:0.0:1787599401.555546:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522338432 00000100:00100000:0.0:1787599401.555629:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1787599401.555640:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:2357:x1874433522338432:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599401.555658:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599401.555684:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741182fb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ce expref: 27 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.555709:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836300) 00010000:00010000:0.0:1787599401.555715:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599401.555814:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:2357:x1874433522338432:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 176us (2617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599401.555823:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00010000:00010000:3.0:1787599401.556075:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741182fc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073d5 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.556098:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182fca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073d5 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.556107:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836300) 00010000:00010000:3.0:1787599401.556110:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787599401.556113:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d200, rc 0) 00000100:00100000:3.0:1787599401.556200:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+25:11378:x1874433522338304:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1196us (3410us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787599401.556210:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 147 00000100:00100000:1.0:1787599401.563692:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599401.566140:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522338560 00000100:00100000:3.0:1787599401.566211:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522338560 00000100:00100000:3.0:1787599401.566312:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:3.0:1787599401.566324:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522338560:12345-192.168.204.30@tcp:1:lfs.0 00010000:00010000:3.0:1787599401.566394:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.566457:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.566481:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599401.566487:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599401.566492:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.566545:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.566562:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 6 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599401.566581:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f2d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874433543315456:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599401.566726:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787599401.576440:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f2d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874433543315456:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599401.576487:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599401.579365:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599401.579564:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522338688 00000100:00100000:0.0:1787599401.579583:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522338688 00002000:00100000:0.0:1787599401.579664:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9f6c4fe22300 x1874433522338688/t0(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:257/0 lens 504/0 e 0 to 0 dl 1787599412 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787599401.579679:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c4fe22300 with x1874433522338688 ext(0->12) 00010000:00010000:0.0:1787599401.579692:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 7 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.579715:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 7 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599401.579723:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f6c4fe22300 00000100:00100000:0.0:1787599401.580439:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:0.0:1787599401.580459:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522338688:12345-192.168.204.30@tcp:4:lfs.0 00000100:00100000:0.0:1787599401.581336:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2359:x1874433522338688:12345-192.168.204.30@tcp:4:lfs.0 Request processed in 876us (1974us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787599401.581356:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00002000:00100000:0.0:1787599401.581368:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9f6c4fe22300 x1874433522338688/t4294967305(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:257/0 lens 504/448 e 0 to 0 dl 1787599412 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787599401.581380:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c4fe22300 with x1874433522338688 ext(0->12) 00010000:00010000:0.0:1787599401.581391:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 9 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.581424:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 9 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599401.581434:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f6c4fe22300 00000100:00100000:3.0:1787599401.592718:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599401.593061:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522338816 00000100:00100000:0.0:1787599401.593079:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522338816 00010000:00010000:0.0:1787599401.593152:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 9 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599401.593248:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:0.0:1787599401.593267:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2358:x1874433522338816:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599401.593299:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787599401.593339:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787599401.593342:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787599400 00002000:00010000:0.0:1787599401.593345:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787599400 00002000:00010000:0.0:1787599401.593347:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787599400 00010000:00010000:0.0:1787599401.593355:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 9 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.593388:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 9 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.593558:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096e07d4d/0xa46cbc6741182f8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073b9 expref: 9 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.593581:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599401.593587:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599401.593595:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.593606:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.593650:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599401.593727:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522338816:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 466us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599401.593737:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00010000:00010000:3.0:1787599401.593740:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.593753:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.593793:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.593815:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.593823:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.593844:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599401.593851:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.593870:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.593887:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.593896:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9e93a41/0xa46cbc6741182fd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599401.593972:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2358:x1874433522338560:12345-192.168.204.30@tcp:1:lfs.0 Request processed in 27650us (30298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599401.593981:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:2.0:1787599401.597291:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599401.598306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522339072 00000100:00100000:0.0:1787599401.598336:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522339072 00000100:00100000:0.0:1787599401.598422:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:0.0:1787599401.598435:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c78450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+25:11378:x1874433522339072:12345-192.168.204.30@tcp:35:lfs.0 00000004:00010000:0.0:1787599401.599287:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182fca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073d5 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787599401.605087:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967419 is committed 00000001:00080000:1.0:1787599401.605111:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967420 is committed 00000001:00080000:0.0:1787599401.605687:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787599401.605972:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787599401.611208:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787599401.611356:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.611398:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ab expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.611418:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.611486:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ab expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.611509:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ab expref: 23 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599401.611539:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1874433543315584:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599401.611698:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70876900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599401.615081:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1874433543315584:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599401.615130:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599401.617840:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599401.618127:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522339200 00000100:00100000:0.0:1787599401.618143:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522339200 00010000:00010000:0.0:1787599401.618277:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ab expref: 24 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599401.618334:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:0.0:1787599401.618348:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:2358:x1874433522339200:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599401.618371:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599401.618381:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ab expref: 24 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.618397:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ab expref: 24 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.618445:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741182f76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ab expref: 24 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.618471:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836300) 00010000:00010000:0.0:1787599401.618478:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.618491:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.618500:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599401.618561:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599401.618646:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:2358:x1874433522339200:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 300us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599401.618655:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00010000:00010000:3.0:1787599401.620667:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.620687:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599401.621433:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787599401.621764:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787599401.621957:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f2d7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874433543315712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787599401.622056:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599401.622107:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599401.622122:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543315712 00000100:00100000:1.0:1787599401.622134:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543315712 00000100:00100000:1.0:1787599401.622248:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599401.622260:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874433543315712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787599401.622375:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874433543315712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 117us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599401.622384:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599401.622645:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f2d7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874433543315712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787599401.623280:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787599401.623722:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c70138700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874433543315840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787599401.623804:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599401.623876:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543315840 00000100:00100000:0.0:1787599401.623885:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543315840 00000100:00100000:0.0:1787599401.623926:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599401.623947:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874433543315840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1787599401.624227:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599401.625240:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787599401.625317:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1874433543315840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1377us (1510us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787599401.625331:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599401.627697:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c70138700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874433543315840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787599401.627853:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787599401.627989:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.628003:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.628011:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.628018:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599401.628024:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.628033:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.630961:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836300) 00010000:00010000:1.0:1787599401.630965:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787599401.630976:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.630985:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fdf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599401.638420:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787599401.638586:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1787599401.638605:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359012447150ns, next at 360012442249ns, rc = 0 00000001:00080000:1.0:1787599401.638618:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787599401.638700:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836300) 00010000:00010000:1.0:1787599401.638706:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787599401.638720:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741182fca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073d5 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599401.644724:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c78450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11378:x1874433522339072:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 46272us (47429us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787599401.644744:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00000020:00080000:1.0:1787599401.644753:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787599401.649464:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599401.649569:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522339328 00000100:00100000:1.0:1787599401.649584:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522339328 00000100:00100000:1.0:1787599401.649663:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:1.0:1787599401.649677:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11378:x1874433522339328:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599401.649726:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599401.649758:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182fe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073dc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.649869:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073dc expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.649887:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182fe6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073dc expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.649920:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:1.0:1787599401.649923:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599401.649929:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9e00, rc 0) 00000100:00100000:1.0:1787599401.650027:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:11378:x1874433522339328:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 353us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599401.650035:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:2.0:1787599401.655577:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599401.655746:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522339584 00000100:00100000:1.0:1787599401.655761:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522339584 00000100:00100000:1.0:1787599401.655848:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:1.0:1787599401.655863:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:11378:x1874433522339584:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1787599401.656464:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:11378:x1874433522339584:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 600us (898us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787599401.656473:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:3.0:1787599401.778782:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599401.778920:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522339840 00000100:00100000:1.0:1787599401.778943:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522339840 00000100:00100000:1.0:1787599401.779034:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 149 00000100:00100000:1.0:1787599401.779049:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:11388:x1874433522339840:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599401.779089:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599401.779123:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073e3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599401.779576:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787599401.779792:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073e3 expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.779811:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:1.0:1787599401.779815:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599401.779821:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741182fed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073e3 expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.779836:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d9200, rc 0) 00000100:00100000:1.0:1787599401.779928:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:11388:x1874433522339840:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 882us (1164us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787599401.779946:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 149 00000100:00100000:0.0:1787599401.787638:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599401.788110:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522339968 00000100:00100000:2.0:1787599401.788125:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522339968 00000100:00100000:2.0:1787599401.788231:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 150 00000100:00100000:2.0:1787599401.788245:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7013b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:11388:x1874433522339968:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:2.0:1787599401.788356:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182ffb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.788380:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182ffb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.788412:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182ffb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.788448:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183002 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.788456:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.788463:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789071:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789094:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789104:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599401.789203:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789220:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182ffb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789228:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182ffb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789236:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182ffb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789256:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599401.789261:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182ffb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789270:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182ffb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789288:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:2.0:1787599401.789291:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599401.789297:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182ffb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789304:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc6741182ffb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789321:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789327:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183002 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789334:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789339:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599401.789342:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789348:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183002 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789368:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c70382000) 00010000:00010000:2.0:1787599401.789371:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599401.789374:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183002 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789380:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789399:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789406:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789412:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789569:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599401.789573:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789580:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789589:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:2.0:1787599401.789591:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599401.789595:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.789600:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183009 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599401.789816:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7013b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:11388:x1874433522339968:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1492us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599401.789828:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 150 00000100:00100000:2.0:1787599401.801433:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599401.801635:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522340224 00000100:00100000:1.0:1787599401.801650:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522340224 00000100:00100000:1.0:1787599401.801739:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:1.0:1787599401.801755:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:11388:x1874433522340224:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1787599401.802739:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+30:11388:x1874433522340224:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 981us (1320us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787599401.802751:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:3.0:1787599401.860294:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599401.860476:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522340480 00000100:00100000:1.0:1787599401.860491:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522340480 00000100:00100000:1.0:1787599401.860576:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 151 00000100:00100000:1.0:1787599401.860590:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+30:11391:x1874433522340480:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599401.860628:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599401.860681:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741183010 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.860809:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741183017 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.860827:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741183017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.860841:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741183017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.860860:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc674118301e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.860867:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc674118301e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.860872:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc674118301e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.861647:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.861661:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599401.861671:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599401.861684:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787599401.862325:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741183017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862337:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741183017 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862345:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741183017 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862351:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599401.862356:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741183017 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862363:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741183017 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862381:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:2.0:1787599401.862384:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599401.862390:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741183017 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862396:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8200/0xa46cbc6741183017 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862412:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc674118301e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862436:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc674118301e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862443:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc674118301e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862448:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d8a00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599401.862451:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc674118301e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862458:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc674118301e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862466:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c50836300) 00010000:00010000:2.0:1787599401.862468:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599401.862471:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc674118301e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862477:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8a00/0xa46cbc674118301e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862543:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9200/0xa46cbc6741183010 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ea expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862560:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ea expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599401.862568:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:2.0:1787599401.862571:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599401.862580:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c582d8400, rc 0) 00000100:00100000:2.0:1787599401.862686:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:11391:x1874433522340480:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2098us (2406us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787599401.862697:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 151 00000100:00100000:0.0:1787599401.865571:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599401.865668:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522340608 00000100:00100000:3.0:1787599401.865681:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522340608 00000100:00100000:3.0:1787599401.865760:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:3.0:1787599401.865772:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:11391:x1874433522340608:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1787599401.865868:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.865888:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.865902:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.865945:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.865974:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183033 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.865981:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.865987:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599401.865992:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.866000:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183033 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.866015:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599401.866018:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599401.866024:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183033 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599401.866030:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599401.866134:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:11391:x1874433522340608:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 363us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599401.866143:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:1.0:1787599401.875502:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599401.875902:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522340864 00000100:00100000:2.0:1787599401.875917:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522340864 00000100:00100000:2.0:1787599401.876017:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:2.0:1787599401.876030:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:11391:x1874433522340864:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1787599401.876424:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+33:11391:x1874433522340864:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 393us (938us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787599401.876434:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 41 00010000:00010000:3.0:1787599401.954402:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599402.018605:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599402.018664:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543315968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599402.018787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599402.019253:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543315968 00000100:00100000:3.0:1787599402.019264:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543315968 00000100:00080000:2.0:1787599402.019398:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599402.019500:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787599402.019514:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543315968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599402.019562:0:12105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599402.019650:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543315968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599402.019658:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787599402.019777:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543315968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599402.210008:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599402.210112:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522341120 00000100:00100000:3.0:1787599402.210125:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522341120 00000100:00100000:3.0:1787599402.210241:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:3.0:1787599402.210255:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+33:11422:x1874433522341120:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:3.0:1787599402.210291:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599402.210322:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118303a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073f1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.210457:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.210474:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.210488:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599402.210501:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787599402.210666:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118303a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f1 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.210691:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f1 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.210838:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599402.210842:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599402.210866:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d800, rc 0) 00000100:00100000:3.0:1787599402.210964:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:11422:x1874433522341120:12345-192.168.204.30@tcp:101:cat.0 Request processed in 712us (970us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787599402.210973:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:0.0:1787599402.214497:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599402.214670:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599402.214690:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522341248 00000100:00100000:1.0:1787599402.214764:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522341248 00000100:00100000:1.0:1787599402.215126:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1787599402.215140:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:2357:x1874433522341248:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599402.215198:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599402.215234:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f1 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599402.215260:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:1.0:1787599402.215265:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599402.215338:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:2357:x1874433522341248:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 200us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599402.215346:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:2.0:1787599402.216127:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522341504 00000100:00100000:2.0:1787599402.216138:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522341504 00000100:00100000:2.0:1787599402.216607:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:2.0:1787599402.216620:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:11422:x1874433522341504:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:2.0:1787599402.217125:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:11422:x1874433522341504:12345-192.168.204.30@tcp:35:cat.0 Request processed in 506us (2455us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787599402.217135:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:0.0:1787599402.285270:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599402.285508:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522341760 00000100:00100000:3.0:1787599402.285524:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522341760 00000100:00100000:3.0:1787599402.286112:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 154 00000100:00100000:3.0:1787599402.286130:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:11428:x1874433522341760:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:3.0:1787599402.286202:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599402.286207:0:8189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787599402.286264:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741182fa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073c7 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.286292:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599402.286298:0:8189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787599402.286319:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118304f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073f8 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.286460:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.286479:0:8189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ea expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.286490:0:8189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.287037:0:8189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ea expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.287088:0:8189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ea expref: 35 pid: 5831 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599402.287106:0:8189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f2d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543316096:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599402.287321:0:8189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599402.296299:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599402.296960:0:8189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f2d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543316096:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599402.297005:0:8189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599402.297279:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522341888 00000100:00100000:0.0:1787599402.297289:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522341888 00010000:00010000:0.0:1787599402.297347:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ea expref: 36 pid: 5831 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599402.297420:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:0.0:1787599402.297432:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58452c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+36:2358:x1874433522341888:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599402.297452:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599402.297461:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ea expref: 36 pid: 5831 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.297474:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ea expref: 36 pid: 5831 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.297502:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8400/0xa46cbc6741183025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ea expref: 36 pid: 5831 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.297521:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:0.0:1787599402.297527:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.297550:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.297560:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.297592:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599402.297673:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58452c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:2358:x1874433522341888:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 242us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599402.297682:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00010000:00010000:3.0:1787599402.298053:0:8189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.298063:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599402.298091:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787599402.298378:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118304f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f8 expref: 36 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.298399:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f8 expref: 35 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.298408:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599402.298410:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787599402.298413:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d800, rc 0) 00000100:00100000:3.0:1787599402.298457:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:11428:x1874433522341760:12345-192.168.204.30@tcp:101:dd.0 Request processed in 12333us (13204us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787599402.298482:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 154 00000100:00100000:1.0:1787599402.307269:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599402.307418:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522342144 00000100:00100000:3.0:1787599402.307432:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522342144 00000100:00100000:3.0:1787599402.307508:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 155 00000100:00100000:3.0:1787599402.307523:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:11428:x1874433522342144:12345-192.168.204.30@tcp:36:dd.0 00010000:00010000:3.0:1787599402.307987:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.308013:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.308029:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599402.308102:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787599402.308131:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1a65361 reply state 000000009e0e7df0 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599402.308143:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599402.308717:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:11428:x1874433522342144:12345-192.168.204.30@tcp:36:dd.0 Request processed in 1193us (1458us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787599402.309946:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 155 00000020:00080000:3.0:1787599402.309957:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787599402.320349:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.320375:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.320383:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.320416:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599402.320424:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.320434:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.320459:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599402.320462:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599402.320468:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.320475:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183064 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599402.629210:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599402.629268:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599402.629313:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599402.629361:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599402.630891:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522342400 00000100:00100000:0.0:1787599402.630943:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522342400 00000100:00100000:0.0:1787599402.631050:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522342528 00000100:00100000:0.0:1787599402.631054:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522342528 00000100:00100000:0.0:1787599402.631087:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:0.0:1787599402.631100:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522342400:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599402.631265:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2356:x1874433522342400:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 167us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599402.631274:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:0.0:1787599402.631295:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:0.0:1787599402.631302:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2356:x1874433522342528:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599402.631328:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2356:x1874433522342528:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599402.631334:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:2.0:1787599402.632767:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522342656 00000100:00100000:2.0:1787599402.632783:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522342656 00000100:00100000:2.0:1787599402.632880:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 157 00000100:00100000:2.0:1787599402.632893:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522342656:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599402.632993:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2356:x1874433522342656:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 103us (3723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599402.633001:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 157 00000100:00100000:3.0:1787599402.633384:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522342272 00000100:00100000:3.0:1787599402.633392:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522342272 00000100:00100000:3.0:1787599402.633445:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 299 00000100:00100000:3.0:1787599402.633454:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522342272:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599402.633491:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522342272:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 39us (4177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599402.633498:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 299 00000100:00080000:1.0:1787599402.634429:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599402.725903:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599402.726433:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522342784 00000100:00100000:0.0:1787599402.726452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522342784 00000100:00100000:0.0:1787599402.726559:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 156 00000100:00100000:0.0:1787599402.726576:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+37:11442:x1874433522342784:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:0.0:1787599402.726615:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599402.726650:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118306b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e073ff expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.726762:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183072 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.726781:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183072 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.726809:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183072 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.726852:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.726873:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.726880:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.727962:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.727988:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f8 expref: 38 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.727998:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.728048:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f8 expref: 38 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.728069:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f8 expref: 38 pid: 8189 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599402.728088:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543316224:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599402.728496:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599402.736827:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543316224:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599402.736877:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599402.740284:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599402.740768:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522343040 00000100:00100000:3.0:1787599402.740784:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522343040 00000100:00100000:3.0:1787599402.742006:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:3.0:1787599402.742027:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:5596:x1874433522343040:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787599402.743767:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+40:5596:x1874433522343040:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 1731us (3489us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787599402.743808:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:1.0:1787599402.767056:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599402.767312:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522343168 00000100:00100000:0.0:1787599402.767329:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522343168 00010000:00010000:0.0:1787599402.767404:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f8 expref: 40 pid: 8189 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599402.767449:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:0.0:1787599402.767461:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+40:2358:x1874433522343168:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599402.767480:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599402.767488:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f8 expref: 40 pid: 8189 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.767504:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f8 expref: 40 pid: 8189 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.767535:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183056 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073f8 expref: 40 pid: 8189 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.767558:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:0.0:1787599402.767563:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.767575:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.767583:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599402.767622:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599402.767867:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:2358:x1874433522343168:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 406us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599402.767877:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00010000:00010000:3.0:1787599402.769756:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.769780:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599402.769999:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787599402.770006:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599402.770048:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770067:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770079:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183072 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770086:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183072 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770095:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183072 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770102:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599402.770107:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183072 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770115:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183072 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770134:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599402.770186:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599402.770193:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770201:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770223:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770230:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183079 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770236:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770241:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ffe00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599402.770245:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770251:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183079 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770259:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c43a07d00) 00010000:00010000:3.0:1787599402.770262:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599402.770265:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183079 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770270:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770328:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118306b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ff expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770358:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ff expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.770367:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599402.770369:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599402.770372:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff600, rc 0) 00000100:00100000:3.0:1787599402.770475:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:11442:x1874433522342784:12345-192.168.204.30@tcp:101:stat.0 Request processed in 43902us (44587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599402.770486:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 156 00000040:00080000:2.0:1787599402.853485:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599402.853501:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599402.853800:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1787599402.853808:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787599402.907312:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599402.907536:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522343424 00000100:00100000:2.0:1787599402.907551:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522343424 00000100:00100000:2.0:1787599402.907631:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 157 00000100:00100000:2.0:1787599402.907644:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:11448:x1874433522343424:12345-192.168.204.30@tcp:36:truncate.0 00010000:00010000:2.0:1787599402.907743:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599402.907794:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff600/0xa46cbc6741183080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073ff expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599402.907822:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:2.0:1787599402.907830:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599402.908495:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599402.908516:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599402.908541:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599402.908606:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787599402.908638:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b23d439c reply state 00000000eb50994a transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599402.908649:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599402.909469:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+40:11448:x1874433522343424:12345-192.168.204.30@tcp:36:truncate.0 Request processed in 1820us (2166us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787599402.909484:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 157 00000020:00080000:2.0:1787599402.909491:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787599402.916670:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.916694:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.916703:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.916711:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599402.916728:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.916737:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.916761:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599402.916765:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599402.916772:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599402.916809:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc6741183087 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599402.979329:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599403.177320:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599403.178017:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522343552 00000100:00100000:3.0:1787599403.178034:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522343552 00000100:00100000:3.0:1787599403.178148:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 158 00000100:00080000:1.0:1787599403.178286:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599403.178331:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:11462:x1874433522343552:12345-192.168.204.30@tcp:101:stat.0 00010000:00010000:3.0:1787599403.178377:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599403.178412:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118308e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07406 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.178505:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183095 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.178665:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.178683:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.178702:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118309c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.178778:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118309c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.178787:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118309c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181417:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181453:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181468:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599403.181535:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787599403.181541:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599403.181571:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181587:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181598:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181605:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183095 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181613:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181621:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599403.181627:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181636:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183095 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181650:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599403.181659:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599403.181666:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183095 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181673:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183095 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181693:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118309c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181700:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118309c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.181706:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118309c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.183880:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599403.183892:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118309c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.183912:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118309c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.183935:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c70860f00) 00010000:00010000:3.0:1787599403.183939:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599403.183945:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118309c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.183953:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118309c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.184042:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118308e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07406 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.184092:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07406 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.184101:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599403.184104:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599403.184107:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d600, rc 0) 00000100:00100000:3.0:1787599403.184991:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+40:11462:x1874433522343552:12345-192.168.204.30@tcp:101:stat.0 Request processed in 6532us (7554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599403.185006:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 158 00000100:00100000:1.0:1787599403.275068:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599403.275214:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522343808 00000100:00100000:0.0:1787599403.275228:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522343808 00000100:00100000:0.0:1787599403.275318:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 159 00000100:00100000:0.0:1787599403.275332:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+40:11472:x1874433522343808:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599403.275367:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599403.275398:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0740d expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599403.276380:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787599403.277690:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0740d expref: 42 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.277791:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599403.277796:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599403.277802:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0740d expref: 42 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.277822:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fea00, rc 0) 00000100:00100000:0.0:1787599403.277940:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+41:11472:x1874433522343808:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2609us (2890us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787599403.277950:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 159 00000100:00100000:0.0:1787599403.281020:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599403.281211:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522344064 00000100:00100000:2.0:1787599403.281226:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522344064 00000100:00100000:2.0:1787599403.281296:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:2.0:1787599403.281310:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+41:11472:x1874433522344064:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1787599403.282923:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c7ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+42:11472:x1874433522344064:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 1594us (1898us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787599403.282940:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:1.0:1787599403.393739:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599403.393873:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522344320 00000100:00100000:0.0:1787599403.393887:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522344320 00000100:00100000:0.0:1787599403.393977:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 160 00000100:00100000:0.0:1787599403.394010:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+42:11478:x1874433522344320:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599403.394048:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599403.394079:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07414 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.394321:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.394342:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07406 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.394352:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.394399:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07406 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.394415:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07406 expref: 43 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599403.394432:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c760edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543316352:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599403.394571:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599403.403572:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599403.403722:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522344448 00000100:00100000:2.0:1787599403.403734:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522344448 00000100:00100000:0.0:1787599403.403742:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c760edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543316352:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599403.403782:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.403798:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07406 expref: 44 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599403.403853:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:2.0:1787599403.403865:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+44:2358:x1874433522344448:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599403.403885:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599403.403894:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07406 expref: 44 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.403923:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07406 expref: 44 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.404084:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411830a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07406 expref: 44 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.404131:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:2.0:1787599403.404137:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.404149:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.407492:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.407584:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599403.407705:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+43:2358:x1874433522344448:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 3834us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599403.407718:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00010000:00010000:0.0:1787599403.408071:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.408108:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599403.408142:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787599403.408413:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07414 expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.408438:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07414 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.408448:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:0.0:1787599403.408452:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787599403.408455:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe400, rc 0) 00000100:00100000:0.0:1787599403.408511:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+43:11478:x1874433522344320:12345-192.168.204.30@tcp:101:bash.0 Request processed in 14505us (14788us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787599403.408534:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 160 00000100:00100000:0.0:1787599403.412944:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599403.413017:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522344704 00000100:00100000:3.0:1787599403.413031:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522344704 00000100:00100000:3.0:1787599403.413112:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 161 00000100:00100000:3.0:1787599403.413126:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+43:11478:x1874433522344704:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:3.0:1787599403.414453:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.414482:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.414497:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599403.414598:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787599403.414634:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076075062 reply state 000000004d210e3c transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599403.414645:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599403.416335:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+46:11478:x1874433522344704:12345-192.168.204.30@tcp:36:bash.0 Request processed in 3199us (3393us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787599403.416348:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 161 00000020:00080000:3.0:1787599403.416357:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787599403.420858:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.420883:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.420892:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.420899:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599403.420916:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.420925:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.420947:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599403.420951:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599403.420957:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.420963:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411830cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599403.426404:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599403.426583:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522344832 00000100:00100000:3.0:1787599403.426597:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522344832 00000100:00100000:3.0:1787599403.426684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 162 00000100:00100000:3.0:1787599403.426698:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+45:11478:x1874433522344832:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1787599403.426746:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599403.426974:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411830d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0741b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.427098:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.427117:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07414 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.427126:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.427299:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07414 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.427315:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07414 expref: 46 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599403.427334:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f2d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543316480:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599403.427449:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599403.434571:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599403.435476:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522344960 00000100:00100000:0.0:1787599403.435492:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522344960 00010000:00010000:0.0:1787599403.435628:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07414 expref: 47 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599403.435851:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:0.0:1787599403.435865:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:2358:x1874433522344960:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599403.435888:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599403.435926:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07414 expref: 47 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.435944:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07414 expref: 47 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.435976:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:0.0:1787599403.435983:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.436005:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.436013:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.436040:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599403.436137:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:2358:x1874433522344960:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 274us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.436146:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00010000:00010000:3.0:1787599403.436432:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07414 expref: 46 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599403.436458:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f2d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543316480:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599403.436489:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.437090:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.437100:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599403.437191:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787599403.437197:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599403.437224:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.437267:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411830d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0741b expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.437303:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0741b expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.437313:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:2.0:1787599403.437316:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599403.437319:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d000, rc 0) 00000100:00100000:2.0:1787599403.437383:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+45:11478:x1874433522344832:12345-192.168.204.30@tcp:101:bash.0 Request processed in 10687us (10996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599403.437392:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 162 00000100:00100000:2.0:1787599403.448085:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599403.448318:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522345216 00000100:00100000:3.0:1787599403.448333:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522345216 00000100:00100000:3.0:1787599403.448413:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:3.0:1787599403.448428:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+45:11478:x1874433522345216:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:3.0:1787599403.449133:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+46:11478:x1874433522345216:12345-192.168.204.30@tcp:35:bash.0 Request processed in 705us (1060us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787599403.449144:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:3.0:1787599403.594832:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599403.595231:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522345472 00000100:00100000:0.0:1787599403.595245:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522345472 00000100:00100000:0.0:1787599403.595324:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 163 00000100:00100000:0.0:1787599403.595336:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+46:11488:x1874433522345472:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599403.595370:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599403.595398:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07422 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599403.595748:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787599403.596106:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07422 expref: 48 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.596126:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:0.0:1787599403.596129:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599403.596135:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07422 expref: 48 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.596150:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fea00, rc 0) 00000100:00100000:0.0:1787599403.596285:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:11488:x1874433522345472:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 950us (1466us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787599403.596295:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 163 00000100:00100000:3.0:1787599403.601864:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599403.602083:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522345600 00000100:00100000:0.0:1787599403.602097:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522345600 00000100:00100000:0.0:1787599403.602210:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 164 00000100:00100000:0.0:1787599403.602224:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:11488:x1874433522345600:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:0.0:1787599403.602333:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602356:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602372:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602392:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602400:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602427:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602842:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602852:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602860:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599403.602932:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602948:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602954:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602962:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602968:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599403.602973:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602981:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.602998:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:0.0:1787599403.603007:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599403.603014:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603021:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411830f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603037:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603042:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603048:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603053:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599403.603056:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603062:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603068:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c43a07400) 00010000:00010000:0.0:1787599403.603071:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599403.603073:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603079:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411830f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603095:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603107:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603112:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603117:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599403.603121:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603127:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603135:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:0.0:1787599403.603138:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599403.603141:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.603146:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411830fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599403.603321:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:11488:x1874433522345600:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1098us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.603331:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 164 00000100:00100000:2.0:1787599403.608796:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599403.608998:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522345856 00000100:00100000:1.0:1787599403.609015:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522345856 00000100:00100000:1.0:1787599403.609095:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:1.0:1787599403.609109:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:11488:x1874433522345856:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1787599403.610386:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+48:11488:x1874433522345856:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 1271us (1608us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787599403.610401:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:3.0:1787599403.646908:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599403.647514:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522346112 00000100:00100000:1.0:1787599403.647546:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522346112 00000100:00100000:1.0:1787599403.647662:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 165 00000100:00100000:1.0:1787599403.647685:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+48:11491:x1874433522346112:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599403.647729:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599403.647766:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183105 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07429 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.647907:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118310c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.647930:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118310c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.647952:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118310c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.647970:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc6741183113 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.647995:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc6741183113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.648001:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc6741183113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649059:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc674118311a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649075:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc674118311a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649085:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc674118311a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599403.649099:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787599403.649543:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118310c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649554:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118310c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649562:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118310c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649569:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddfa00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599403.649575:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118310c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649584:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118310c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649618:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:1.0:1787599403.649621:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599403.649628:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118310c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649648:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118310c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649667:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc6741183113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649673:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc6741183113 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649686:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc6741183113 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649691:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddec00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599403.649693:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc6741183113 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649699:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc6741183113 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649706:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c50836b00) 00010000:00010000:1.0:1787599403.649708:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599403.649711:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc6741183113 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649716:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc6741183113 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649794:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183105 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07429 expref: 51 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649811:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc674118311a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07429 expref: 50 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.649819:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:1.0:1787599403.649821:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599403.649823:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75dde400, rc 0) 00000100:00100000:1.0:1787599403.649939:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:11491:x1874433522346112:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2263us (3057us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787599403.649949:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 165 00000100:00100000:0.0:1787599403.654087:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599403.654146:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599403.654426:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522346368 00000100:00100000:1.0:1787599403.654441:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522346368 00000100:00100000:1.0:1787599403.654538:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1787599403.654551:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:2358:x1874433522346368:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599403.654575:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599403.654613:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc674118311a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07429 expref: 50 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.654655:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:1.0:1787599403.654662:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599403.654738:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:2358:x1874433522346368:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 190us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599403.654746:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1787599403.655336:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522346240 00000100:00100000:3.0:1787599403.655345:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522346240 00000100:00100000:3.0:1787599403.655393:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 166 00000100:00100000:3.0:1787599403.655401:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c760ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:11491:x1874433522346240:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1787599403.655478:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.655497:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.655508:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.655541:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.655547:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183128 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.655565:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.655572:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599403.655578:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.655586:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.655597:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599403.655600:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599403.655605:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183128 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.655611:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599403.655696:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c760ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:11491:x1874433522346240:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 294us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599403.655703:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 166 00000100:00100000:0.0:1787599403.665733:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599403.665837:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522346624 00000100:00100000:3.0:1787599403.665851:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522346624 00000100:00100000:3.0:1787599403.665931:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:3.0:1787599403.665943:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+49:11491:x1874433522346624:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1787599403.666296:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:11491:x1874433522346624:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 354us (578us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787599403.666305:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:0.0:1787599403.824729:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599403.825221:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522346880 00000100:00100000:3.0:1787599403.825236:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522346880 00000100:00100000:3.0:1787599403.825336:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 167 00000100:00100000:3.0:1787599403.825349:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:11509:x1874433522346880:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:3.0:1787599403.825386:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599403.825415:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118312f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07430 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.825884:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183136 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.825915:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183136 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.825931:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183136 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599403.825950:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787599403.826141:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc674118312f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07430 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.826823:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183136 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07430 expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.826837:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599403.826840:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787599403.826845:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c200, rc 0) 00000100:00100000:3.0:1787599403.826971:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11509:x1874433522346880:12345-192.168.204.30@tcp:101:cat.0 Request processed in 1621us (2272us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787599403.827008:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 167 00000100:00100000:0.0:1787599403.864013:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599403.864215:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522347008 00000100:00100000:3.0:1787599403.864231:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522347008 00000100:00100000:3.0:1787599403.864316:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 168 00000100:00100000:3.0:1787599403.864330:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11510:x1874433522347008:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599403.864366:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599403.864396:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07437 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.864495:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118314b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.864513:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118314b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.864527:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118314b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599403.865016:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787599403.865022:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599403.865113:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118314b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.865192:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07437 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.865218:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118314b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07437 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599403.865243:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599403.865246:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599403.865251:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d600, rc 0) 00000100:00100000:3.0:1787599403.865339:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:11510:x1874433522347008:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1009us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599403.865348:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 168 00000100:00100000:0.0:1787599403.880793:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599403.881446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522347392 00000100:00100000:3.0:1787599403.881462:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522347392 00000100:00100000:3.0:1787599403.881529:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:3.0:1787599403.881542:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:11510:x1874433522347392:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1787599403.882242:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:11510:x1874433522347392:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 698us (1463us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787599403.882252:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:0.0:1787599403.896945:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599403.899448:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522347520 00000100:00100000:1.0:1787599403.899471:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522347520 00000100:00100000:1.0:1787599403.899687:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:1.0:1787599403.899701:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:11510:x1874433522347520:12345-192.168.204.30@tcp:103:lfs.0 00010000:00010000:1.0:1787599403.899725:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787599403.899759:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411830db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0741b expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.899790:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183136 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07430 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.899806:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d9e00/0xa46cbc6741182fe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073dc expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599403.899817:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:1.0:1787599403.899831:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599403.899954:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:11510:x1874433522347520:12345-192.168.204.30@tcp:103:lfs.0 Request processed in 255us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599403.899963:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:0.0:1787599403.904524:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599403.905102:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522347648 00000100:00100000:2.0:1787599403.905116:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522347648 00000100:00100000:2.0:1787599403.905228:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 169 00000100:00100000:2.0:1787599403.905241:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:11510:x1874433522347648:12345-192.168.204.30@tcp:58:lfs.0 00010000:00010000:2.0:1787599403.905429:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183152 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.905451:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599403.905466:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599403.906544:0:8189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787599403.907029:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:11510:x1874433522347648:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 1783us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.907042:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 169 00000100:00100000:3.0:1787599403.934072:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599403.934441:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522347776 00000100:00100000:0.0:1787599403.934458:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522347776 00000100:00100000:0.0:1787599403.934552:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 170 00000100:00100000:0.0:1787599403.934565:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:11512:x1874433522347776:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599403.934597:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599403.934629:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183159 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0743e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.935135:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183160 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.935462:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183160 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.935480:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183160 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.935502:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.935510:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.935517:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936471:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936488:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936497:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599403.936558:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787599403.936564:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599403.936591:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936607:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936618:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183160 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936625:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183160 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936632:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183160 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936640:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599403.936645:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183160 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936654:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183160 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936689:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:0.0:1787599403.936692:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599403.936698:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183160 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936705:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc6741183160 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936721:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936728:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183167 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936734:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936740:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599403.936744:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936750:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183167 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936758:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c43a07400) 00010000:00010000:0.0:1787599403.936760:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599403.936763:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183167 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936768:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936832:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183159 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0743e expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936850:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0743e expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599403.936858:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c70382000) 00010000:00010000:0.0:1787599403.936860:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599403.936863:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ffa00, rc 0) 00000100:00100000:0.0:1787599403.936978:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11512:x1874433522347776:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2413us (2925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599403.936987:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 170 00010000:00010000:3.0:1787599404.008247:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599404.065546:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543316992:0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.065668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599404.065783:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599404.065790:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543316864:0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.065844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599404.065899:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543316992 00000100:00100000:2.0:1787599404.065911:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543316992 00000100:00100000:2.0:1787599404.065986:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787599404.065998:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543316992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.066064:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543316992:12345-0@lo:400:kworker.0 Request processed in 68us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599404.066071:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787599404.066126:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543316992:0@lo:400:kworker.0 00000100:00100000:0.0:1787599404.066197:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543316736:0@lo:400:kworker.0 00000100:00100000:0.0:1787599404.066235:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599404.066261:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543317248:0@lo:400:kworker.0 00000004:00080000:2.0:1787599404.066266:0:8126:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361440108533ns, next at 362440105431ns, rc = 0 00000100:00100000:2.0:1787599404.066290:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599404.066290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599404.066297:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543317376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599404.066314:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787599404.066321:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543316608:0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.066322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599404.066347:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543317376 00000100:00100000:2.0:1787599404.066352:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543317376 00000100:00100000:0.0:1787599404.066354:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599404.066374:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543317120:0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.066382:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787599404.066389:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874433543317376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599404.066400:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787599404.066431:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599404.066431:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543316608 00000100:00100000:0.0:1787599404.066434:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543316608 00000100:00100000:0.0:1787599404.066463:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787599404.066469:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874433543317376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599404.066470:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543316608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.066475:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787599404.066505:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543317376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599404.066513:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543316608:12345-0@lo:400:kworker.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599404.066519:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787599404.066537:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543316864 00000100:00100000:2.0:1787599404.066540:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543316864 00000100:00100000:0.0:1787599404.066552:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543316608:0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.066576:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543316736 00000100:00100000:2.0:1787599404.066580:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543316736 00000100:00100000:3.0:1787599404.066654:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543317248 00000100:00100000:3.0:1787599404.066667:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543317248 00000100:00100000:3.0:1787599404.066718:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787599404.066726:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874433543317248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599404.066783:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874433543317248:12345-0@lo:400:kworker.0 Request processed in 58us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599404.066794:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787599404.066828:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543317248:0@lo:400:kworker.0 00000100:00080000:1.0:1787599404.066898:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599404.066904:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599404.066907:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599404.069309:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543317120 00000100:00100000:0.0:1787599404.069336:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543317120 00000100:00100000:0.0:1787599404.069459:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787599404.069471:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543316864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.069472:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787599404.069484:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543316736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.069693:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543316736:12345-0@lo:400:kworker.0 Request processed in 211us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599404.069702:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787599404.069725:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787599404.069732:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543317120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.069768:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543317120:12345-0@lo:400:kworker.0 Request processed in 37us (3367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599404.069774:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787599404.069886:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543317120:0@lo:400:kworker.0 00000100:00100000:2.0:1787599404.069911:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543316736:0@lo:400:kworker.0 00000100:00080000:2.0:1787599404.069960:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599404.070878:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543316864:12345-0@lo:400:kworker.0 Request processed in 1403us (5027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599404.070957:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787599404.071334:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543316864:0@lo:400:kworker.0 00000040:00080000:0.0:1787599404.899737:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599404.899753:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599404.899824:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787599404.899833:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599404.900042:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543317504:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599404.900227:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787599404.914285:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543317504:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787599404.914926:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599404.915101:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522347904 00000100:00100000:3.0:1787599404.915117:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522347904 00000100:00100000:3.0:1787599404.915224:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 171 00000100:00100000:3.0:1787599404.915236:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11523:x1874433522347904:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787599404.915279:0:8189:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787599404.915427:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11523:x1874433522347904:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 193us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599404.915435:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 171 00000100:00100000:1.0:1787599404.921316:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599404.921443:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522348032 00000100:00100000:2.0:1787599404.921457:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522348032 00000100:00100000:2.0:1787599404.921575:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 172 00000100:00100000:2.0:1787599404.921589:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11523:x1874433522348032:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787599404.921707:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183175 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.921728:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183175 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.921762:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183175 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.921943:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc674118317c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.921968:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc674118317c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.921981:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc674118317c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922021:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922030:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922037:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599404.922338:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787599404.922343:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599404.922358:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922371:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183175 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922378:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183175 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922404:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183175 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922409:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599404.922414:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183175 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922420:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183175 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922433:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:2.0:1787599404.922436:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599404.922440:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183175 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922446:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183175 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922462:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc674118317c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922469:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc674118317c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922474:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc674118317c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922479:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599404.922482:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc674118317c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922499:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc674118317c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922508:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9f6c70382300) 00010000:00010000:2.0:1787599404.922511:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599404.922514:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc674118317c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922520:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc674118317c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922540:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922546:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922551:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922555:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599404.922558:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922564:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922571:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c70382000) 00010000:00010000:2.0:1787599404.922573:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599404.922575:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.922591:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599404.922713:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11523:x1874433522348032:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 1123us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599404.922723:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 172 00000100:00100000:1.0:1787599404.929599:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599404.929817:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522348288 00000100:00100000:2.0:1787599404.929832:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522348288 00000100:00100000:2.0:1787599404.929929:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 173 00000100:00100000:2.0:1787599404.929942:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11523:x1874433522348288:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599404.929971:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599404.929999:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc674118318a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07445 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.930394:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183191 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.930485:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.930502:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599404.930516:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787599404.930649:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.930658:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183191 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.930683:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.930690:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599404.931542:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.931555:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183191 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.931574:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c70382000) 00010000:00010000:2.0:1787599404.931578:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599404.931584:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183191 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.931591:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183191 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.931662:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc674118318a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07445 expref: 54 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.931676:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:2.0:1787599404.931678:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599404.931683:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc674118318a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07445 expref: 54 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.932666:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031600, rc 0) 00000100:00100000:2.0:1787599404.933515:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:11523:x1874433522348288:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 3566us (3920us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787599404.933542:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 173 00000100:00100000:2.0:1787599404.940649:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599404.941504:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522348416 00000100:00100000:0.0:1787599404.941521:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522348416 00000100:00100000:0.0:1787599404.941608:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:0.0:1787599404.941621:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:11523:x1874433522348416:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787599404.941670:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787599404.941827:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:11523:x1874433522348416:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 208us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599404.942566:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:1.0:1787599404.949120:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599404.949454:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522348672 00000100:00100000:2.0:1787599404.949468:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522348672 00000100:00100000:2.0:1787599404.949540:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:2.0:1787599404.949554:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:11523:x1874433522348672:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599404.949586:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599404.949591:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787599404.949629:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc674118314b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07437 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.949654:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:2.0:1787599404.949660:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599404.949750:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc674118319f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0744c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787599404.954085:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787599404.954436:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411831a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.954460:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411831a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.954474:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411831a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.954573:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc674118319f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0744c expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.954614:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411831a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0744c expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599404.954624:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70382300) 00010000:00010000:2.0:1787599404.954628:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599404.954633:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030e00, rc 0) 00000100:00100000:2.0:1787599404.954738:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:11523:x1874433522348672:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 5186us (5627us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787599404.954748:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:2.0:1787599404.965756:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599404.966055:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522348928 00000100:00100000:3.0:1787599404.966070:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522348928 00000100:00100000:3.0:1787599404.966176:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 176 00000100:00100000:3.0:1787599404.966190:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:11523:x1874433522348928:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787599404.966269:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599404.966306:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411831a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0744c expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.966329:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70382300) 00010000:00010000:3.0:1787599404.966343:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787599404.966372:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411831b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.966403:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411831b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.966414:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411831b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.966431:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411831bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd3e5dbe4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.966450:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411831bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3e5dbe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.966457:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411831bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3e5dbe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968002:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411831b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968021:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411831b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968029:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411831b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968036:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599404.968108:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411831b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968120:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411831b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968139:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599404.968143:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599404.968229:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411831b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968238:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411831b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968257:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411831bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3e5dbe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968270:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411831bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3e5dbe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968277:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411831bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3e5dbe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968282:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599404.968286:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411831bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3e5dbe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968294:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411831bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd3e5dbe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968303:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd3e5dbe4 (ffff9f6c70860f00) 00010000:00010000:3.0:1787599404.968307:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599404.968310:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411831bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd3e5dbe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.968316:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411831bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd3e5dbe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599404.968548:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:11523:x1874433522348928:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 2355us (2800us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787599404.968559:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 176 00000100:00100000:2.0:1787599404.975908:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599404.975991:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522349056 00000100:00100000:3.0:1787599404.976004:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522349056 00000100:00100000:3.0:1787599404.976286:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 177 00000100:00100000:3.0:1787599404.976302:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+53:11523:x1874433522349056:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599404.976333:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599404.976383:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411831c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07453 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.976431:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.976447:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.976462:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.976587:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc67411831c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07453 expref: 55 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.976611:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07453 expref: 54 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599404.976621:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70860500) 00010000:00010000:3.0:1787599404.976625:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599404.976630:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c200, rc 0) 00000100:00100000:3.0:1787599404.978283:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:11523:x1874433522349056:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1972us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599404.978299:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 177 00000100:00100000:3.0:1787599404.988314:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599404.992410:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522349312 00000100:00100000:1.0:1787599404.992431:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522349312 00000100:00100000:1.0:1787599404.992526:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 178 00000100:00100000:1.0:1787599404.992549:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:11523:x1874433522349312:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787599404.993409:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599404.993434:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599404.993448:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599404.993837:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787599404.993850:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362367692154ns, next at 363367689217ns, rc = 0 00000004:00010000:1.0:1787599404.993982:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027399acb reply state 0000000013ed813d transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599404.993995:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787599404.994145:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:11523:x1874433522349312:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 1596us (5847us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787599404.994527:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 178 00010000:00010000:3.0:1787599405.000725:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.000750:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.000772:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.000779:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddfa00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599405.000785:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.000794:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.000816:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70860500) 00010000:00010000:3.0:1787599405.000819:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787599405.000823:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.000829:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc67411831d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599405.001498:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599405.001598:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522349440 00000100:00100000:1.0:1787599405.001612:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522349440 00000100:00100000:1.0:1787599405.001702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 179 00000100:00100000:1.0:1787599405.001717:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:11523:x1874433522349440:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599405.001752:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599405.001776:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc67411831d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0745a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.001853:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc67411831d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0745a expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.001901:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc67411831d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0745a expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.001927:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70860500) 00010000:00010000:1.0:1787599405.001930:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599405.001934:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75ddea00, rc 0) 00000100:00100000:1.0:1787599405.002008:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:11523:x1874433522349440:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 294us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599405.002015:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 179 00000100:00080000:3.0:1787599405.002508:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599405.018260:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599405.019475:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522349568 00000100:00100000:2.0:1787599405.019491:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522349568 00000100:00100000:2.0:1787599405.019587:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:2.0:1787599405.019602:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522349568:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787599405.020074:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522349568:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 474us (1830us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787599405.020084:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00080000:3.0:1787599405.020651:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787599405.024964:0:12439:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599405.024978:0:12439:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599405.025023:0:12439:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787599405.025030:0:12439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787599405.030503:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599405.030613:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522349824 00000100:00100000:0.0:1787599405.030628:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522349824 00000100:00100000:0.0:1787599405.030718:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:0.0:1787599405.030731:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:11523:x1874433522349824:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787599405.031079:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:11523:x1874433522349824:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 349us (590us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787599405.031088:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:3.0:1787599405.037088:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599405.037229:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522350080 00000100:00100000:3.0:1787599405.037241:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522350080 00000100:00100000:3.0:1787599405.037314:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 180 00000100:00100000:3.0:1787599405.037326:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:11523:x1874433522350080:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787599405.037477:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:11523:x1874433522350080:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 152us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599405.037486:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 180 00010000:00010000:1.0:1787599405.041253:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599405.041427:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599405.042519:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522350208 00000100:00100000:1.0:1787599405.042536:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522350208 00000100:00100000:1.0:1787599405.042618:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 181 00000100:00100000:1.0:1787599405.042632:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:11523:x1874433522350208:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599405.042661:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599405.042688:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde600/0xa46cbc67411831de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07461 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.042783:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf600/0xa46cbc67411831e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.042802:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf600/0xa46cbc67411831e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.042817:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf600/0xa46cbc67411831e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599405.042891:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599405.042917:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf600/0xa46cbc67411831e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.042950:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde600/0xa46cbc67411831de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07461 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.042970:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf600/0xa46cbc67411831e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07461 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.042980:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70860500) 00010000:00010000:1.0:1787599405.042984:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787599405.042989:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75ddf600, rc 0) 00000100:00100000:1.0:1787599405.043078:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:11523:x1874433522350208:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 448us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599405.043086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 181 00000100:00100000:1.0:1787599405.064493:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599405.068675:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522350336 00000100:00100000:3.0:1787599405.068700:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522350336 00000100:00100000:3.0:1787599405.068853:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:3.0:1787599405.068878:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2358:x1874433522350336:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599405.068907:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599405.068939:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e07d4d/0xa46cbc67411831ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07468 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787599405.068980:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9a2b, blocks: 0x1 00010000:00010000:3.0:1787599405.069007:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:3.0:1787599405.069013:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599405.069026:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e07d4d/0xa46cbc67411831ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07468 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.069050:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096e07d4d/0xa46cbc67411831ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07468 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.069069:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d600, rc 0) 00000100:00100000:3.0:1787599405.069185:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522350336:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 319us (4707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599405.069192:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:3.0:1787599405.088925:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599405.089027:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522350592 00000100:00100000:1.0:1787599405.089041:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522350592 00000100:00100000:1.0:1787599405.089120:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 182 00000100:00100000:1.0:1787599405.089134:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:11523:x1874433522350592:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787599405.089316:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:11523:x1874433522350592:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 184us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599405.089435:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 182 00000100:00100000:0.0:1787599405.097530:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599405.097584:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522350720 00000100:00100000:0.0:1787599405.097598:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522350720 00000100:00100000:0.0:1787599405.097670:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:0.0:1787599405.097685:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:11523:x1874433522350720:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599405.097714:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599405.097740:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0746f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599405.097783:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096e07d4d/0xa46cbc67411831ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07468 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599405.097793:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599405.097799:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599405.097805:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599405.097848:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096e07d4d/0xa46cbc67411831ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07468 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599405.097894:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096e07d4d/0xa46cbc67411831ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07468 expref: 9 pid: 6679 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599405.097913:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874433543317632:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599405.098031:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c81fd4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599405.101372:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599405.101602:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874433543317632:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599405.101647:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.101691:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fee00, rc 0) 00000100:00100000:2.0:1787599405.101770:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:11523:x1874433522350720:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 4087us (4254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599405.101780:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:1.0:1787599405.102932:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522350848 00000100:00100000:1.0:1787599405.102947:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522350848 00010000:00010000:1.0:1787599405.103020:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096e07d4d/0xa46cbc67411831ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07468 expref: 9 pid: 6679 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599405.103064:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:1.0:1787599405.103078:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2358:x1874433522350848:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599405.103098:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599405.103130:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096e07d4d/0xa46cbc67411831ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07468 expref: 9 pid: 6679 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.103178:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096e07d4d/0xa46cbc67411831ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07468 expref: 9 pid: 6679 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.103209:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e07d4d/0xa46cbc67411831ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07468 expref: 9 pid: 6679 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.103223:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599405.103229:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599405.103239:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.103251:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.103301:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599405.105896:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5817:1874433543317760:192.168.204.30@tcp:105: 00000100:00100000:1.0:1787599405.106038:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c42b6b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599405.124115:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599405.124323:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5817:1874433543317760:192.168.204.30@tcp:105: 00010000:00010000:2.0:1787599405.124354:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599405.124437:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522350848:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 21361us (23080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599405.124451:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:2.0:1787599405.124504:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522350976 00000100:00100000:2.0:1787599405.124512:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522350976 00002000:00100000:2.0:1787599405.124569:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9f6c6f2d7800 x1874433522350976/t0(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:261/0 lens 504/0 e 0 to 0 dl 1787599416 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599405.124583:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c6f2d7800 with x1874433522350976 ext(0->8) 00002000:00010000:2.0:1787599405.124588:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c6f2d7800 00000100:00100000:2.0:1787599405.124624:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1787599405.124635:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522350976:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787599405.125243:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:2358:x1874433522350976:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 Request processed in 607us (1142us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787599405.125253:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00002000:00100000:2.0:1787599405.125261:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9f6c6f2d7800 x1874433522350976/t4294967314(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:261/0 lens 504/448 e 0 to 0 dl 1787599416 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787599405.125282:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c6f2d7800 with x1874433522350976 ext(0->8) 00002000:00010000:2.0:1787599405.125287:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c6f2d7800 00000100:00100000:1.0:1787599405.145891:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599405.145933:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522351104 00000100:00100000:1.0:1787599405.145947:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522351104 00000100:00100000:1.0:1787599405.146029:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 183 00000100:00100000:1.0:1787599405.146041:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:11523:x1874433522351104:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787599405.175774:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1787599405.175797:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1787599405.244224:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:11523:x1874433522351104:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 98166us (98339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599405.244241:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 183 00000001:00080000:1.0:1787599405.244293:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1787599405.244318:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f6c514d8000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787599405.244323:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c81f5f200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c514d8d80 00000020:00080000:1.0:1787599405.244327:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c81f5fc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c75996c00 00000004:00080000:1.0:1787599405.244506:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1787599405.244531:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1787599405.244554:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787599405.245094:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1787599405.245956:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599405.245980:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543317888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787599405.246072:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787599405.246770:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787599405.246913:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599405.247175:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543317888 00000100:00100000:3.0:1787599405.247187:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543317888 00000100:00100000:3.0:1787599405.247256:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787599405.247269:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543317888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787599405.247492:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787599405.247496:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787599404 00002000:00010000:3.0:1787599405.247500:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787599405.247502:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787599403 -> 1787599404 00002000:00010000:3.0:1787599405.247505:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787599405.247600:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1874433543317888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 332us (1525us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787599405.247609:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787599405.248839:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599405.249108:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522351232 00000100:00100000:1.0:1787599405.249120:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522351232 00000100:00100000:1.0:1787599405.249225:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:1.0:1787599405.249236:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:2357:x1874433522351232:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787599405.249481:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543318016:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787599405.249553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599405.249640:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543318016 00000100:00100000:2.0:1787599405.249644:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543318016 00000100:00100000:2.0:1787599405.249669:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787599405.249675:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543318016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787599405.250981:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1787599405.251039:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c9a28, atime: 0x6a8c9a28, ctime: 0x6a8c9a28, blocks: 0xb 00010000:00010000:2.0:1787599405.251051:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000534dc865/0xa46cbc67411831fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.251072:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1787599405.251078:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599405.251085:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000534dc865/0xa46cbc67411831fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.251107:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000534dc865/0xa46cbc67411831fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.251119:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000534dc865/0xa46cbc67411831fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.251127:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000534dc865/0xa46cbc67411831fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.251253:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787599405.252681:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874433543318016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2996us (3118us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787599405.252706:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:2.0:1787599405.252749:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599405.252759:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000534dc865/0xa46cbc67411831fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.252772:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599405.252778:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000534dc865/0xa46cbc67411831fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.252790:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000534dc865/0xa46cbc67411831fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.252819:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000534dc865/0xa46cbc67411831fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.252826:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000534dc865/0xa46cbc67411831fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.252849:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599405.252851:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599405.252853:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787599405.255342:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c6f2d6300/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787599405.255363:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543317888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787599405.255826:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787599405.255835:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1787599405.255881:0:3302:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9f6c6f27c000 x1874433543318016/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787599421 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787599405.255894:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c6f27c000/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787599405.255898:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543318016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787599405.377760:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:2357:x1874433522351232:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 128508us (128911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599405.377777:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00000001:00080000:0.0:1787599405.378425:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1787599405.378449:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1787599405.382534:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599405.382773:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522351488 00000100:00100000:3.0:1787599405.382786:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522351488 00000100:00100000:3.0:1787599405.382917:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 184 00000100:00100000:3.0:1787599405.382931:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:11523:x1874433522351488:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787599405.383015:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599405.383058:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf600/0xa46cbc67411831e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07461 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.383084:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70860500) 00010000:00010000:3.0:1787599405.383091:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787599405.383146:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.383220:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.383232:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599405.383594:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041143539 reply state 00000000ad168924 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599405.383609:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599405.384291:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:11523:x1874433522351488:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 1201us (1611us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787599405.384303:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 184 00000100:00100000:3.0:1787599405.388662:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599405.388754:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522351616 00000100:00100000:0.0:1787599405.388769:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522351616 00000100:00100000:0.0:1787599405.388845:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:0.0:1787599405.388857:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522351616:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787599405.389261:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787599405.389265:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787599404 -> 1787599402 00002000:00010000:0.0:1787599405.389268:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787599400 00002000:00010000:0.0:1787599405.389271:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787599404 -> 1787599402 00002000:00010000:0.0:1787599405.389273:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787599405.389350:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522351616:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 495us (715us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787599405.389359:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00010000:00010000:2.0:1787599405.390499:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.390539:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.390548:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.390554:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599405.390560:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.390570:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.390593:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70860500) 00010000:00010000:2.0:1787599405.390597:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599405.390602:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.390609:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183201 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599405.393377:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599405.393505:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522351872 00000100:00100000:1.0:1787599405.393519:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522351872 00000100:00100000:1.0:1787599405.393600:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 185 00000100:00100000:1.0:1787599405.393615:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:11523:x1874433522351872:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787599405.393729:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.393752:0:8189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07453 expref: 18 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.393763:0:8189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.393813:0:8189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07453 expref: 18 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.393831:0:8189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07453 expref: 18 pid: 8189 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599405.393884:0:8189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543318144:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599405.394002:0:8189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599405.397891:0:8189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543318144:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599405.397933:0:8189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599405.400114:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599405.400365:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522352000 00000100:00100000:1.0:1787599405.400379:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522352000 00010000:00010000:1.0:1787599405.400443:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07453 expref: 19 pid: 8189 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599405.400487:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:1.0:1787599405.400500:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58451c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:2358:x1874433522352000:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599405.400519:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599405.400528:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07453 expref: 19 pid: 8189 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.400543:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07453 expref: 19 pid: 8189 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.400571:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411831c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07453 expref: 19 pid: 8189 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.400594:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70860500) 00010000:00010000:1.0:1787599405.400601:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.400612:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.400768:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.400904:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599405.400990:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58451c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:2358:x1874433522352000:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 492us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599405.401000:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00010000:00010000:2.0:1787599405.402630:0:8189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.402661:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.402708:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.402715:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.402746:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.402753:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75dde200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599405.402758:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.402767:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.402786:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70860500) 00010000:00010000:2.0:1787599405.402789:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787599405.402795:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.402802:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183208 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.402969:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+17:11523:x1874433522351872:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 Request processed in 9351us (9603us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787599405.402982:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 185 00000100:00100000:1.0:1787599405.406881:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599405.406988:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522352128 00000100:00100000:3.0:1787599405.407001:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522352128 00000100:00100000:3.0:1787599405.407608:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:3.0:1787599405.407628:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522352128:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787599405.407709:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.407743:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.407752:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599405.407758:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599405.407764:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.407852:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.407883:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 8 pid: 6678 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599405.407903:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874433543318272:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599405.408030:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599405.411914:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599405.412019:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522352256 00000100:00100000:2.0:1787599405.412034:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522352256 00010000:00010000:2.0:1787599405.412090:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 9 pid: 6678 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.412148:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:2.0:1787599405.412184:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2358:x1874433522352256:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599405.412219:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599405.412251:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 9 pid: 6678 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.412266:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 9 pid: 6678 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.412300:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599405.412307:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599405.412314:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.412325:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.412355:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599405.412435:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2358:x1874433522352256:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 276us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599405.412444:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00010000:00010000:3.0:1787599405.413259:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc67411831f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0746f expref: 8 pid: 6678 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599405.413285:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874433543318272:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599405.413325:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.413340:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.413347:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.413394:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.413427:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.413438:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.413446:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599405.413451:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.413461:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.413480:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.413488:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cff042cc/0xa46cbc674118320f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599405.413566:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2358:x1874433522352128:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 5944us (6710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599405.413575:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:0.0:1787599405.416574:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599405.416667:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522352512 00000100:00100000:1.0:1787599405.416680:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522352512 00000100:00100000:1.0:1787599405.416756:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 186 00000100:00100000:1.0:1787599405.416770:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+17:11523:x1874433522352512:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787599405.416904:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183216 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.416926:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.416940:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.417391:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.417407:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc67411831d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0745a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.417417:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.417488:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc67411831d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0745a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.417505:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc67411831d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0745a expref: 18 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599405.417523:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543318400:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599405.417638:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599405.419881:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543318400:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599405.419924:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599405.420545:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599405.420790:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522352640 00000100:00100000:1.0:1787599405.420801:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522352640 00010000:00010000:1.0:1787599405.420853:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc67411831d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0745a expref: 19 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599405.420945:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:1.0:1787599405.420957:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:2359:x1874433522352640:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599405.420978:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599405.420986:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc67411831d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0745a expref: 19 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.421001:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc67411831d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0745a expref: 19 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.421028:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc67411831d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0745a expref: 19 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.421050:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70860500) 00010000:00010000:1.0:1787599405.421068:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.421079:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.421087:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.421124:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599405.421253:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:2359:x1874433522352640:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 297us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599405.421262:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00010000:00010000:3.0:1787599405.421364:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.421375:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599405.422438:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787599405.422657:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787599405.422713:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787599405.422832:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1874433543318528:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787599405.422949:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599405.423009:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599405.423544:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543318528 00000100:00100000:0.0:1787599405.423555:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543318528 00000100:00100000:0.0:1787599405.423664:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599405.423678:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1874433543318528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787599405.423810:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1874433543318528:12345-0@lo:1000:mdt00_001.0 Request processed in 136us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599405.423819:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787599405.423924:0:5832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787599405.423931:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c6f2d6300, transno 4294967315 00000100:00100000:3.0:1787599405.423958:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1874433543318528:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787599405.424649:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787599405.424732:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1874433543318656:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787599405.424830:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599405.424877:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599405.424918:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543318656 00000100:00100000:1.0:1787599405.424926:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543318656 00000100:00100000:1.0:1787599405.424978:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599405.425187:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874433543318656:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787599405.425552:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1874433543318656:12345-0@lo:1000:mdt00_001.0 Request processed in 564us (722us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787599405.425560:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599405.426050:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1874433543318656:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787599405.426099:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426111:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426121:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426145:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599405.426151:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426183:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426204:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70860500) 00010000:00010000:3.0:1787599405.426207:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787599405.426213:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426219:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc674118321d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426263:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426270:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183152 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426276:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183152 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426282:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030a00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599405.426285:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183152 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426291:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183152 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426312:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c70382000) 00010000:00010000:3.0:1787599405.426315:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787599405.426318:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183152 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426325:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183152 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426356:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426372:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0743e expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426382:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426424:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0743e expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.426566:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0743e expref: 21 pid: 5831 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599405.426583:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76164000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543318784:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599405.426687:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70849cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599405.431339:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76164000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543318784:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599405.431390:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599405.431878:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599405.432203:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522352768 00000100:00100000:0.0:1787599405.432214:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522352768 00010000:00010000:0.0:1787599405.432270:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0743e expref: 22 pid: 5831 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599405.432316:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:0.0:1787599405.432328:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:2359:x1874433522352768:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599405.432347:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599405.432356:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0743e expref: 22 pid: 5831 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599405.432371:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0743e expref: 22 pid: 5831 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599405.432400:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc674118316e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0743e expref: 22 pid: 5831 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599405.432434:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c70382000) 00010000:00010000:0.0:1787599405.432440:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599405.432452:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599405.432461:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599405.432491:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599405.432571:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:2359:x1874433522352768:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 244us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599405.432579:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 71 00010000:00010000:3.0:1787599405.432990:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.432999:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433014:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433020:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433027:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433033:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599405.433038:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433046:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433055:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c70382000) 00010000:00010000:3.0:1787599405.433058:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599405.433061:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433066:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183224 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433080:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183216 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433096:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183216 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433102:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183216 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433108:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddee00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599405.433111:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183216 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433117:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183216 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433124:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c70382000) 00010000:00010000:3.0:1787599405.433126:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599405.433141:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183216 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599405.433147:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183216 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599405.433460:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:11523:x1874433522352512:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 16691us (16899us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787599405.433472:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 186 00000020:00080000:3.0:1787599405.433477:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787599405.433960:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599405.433966:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599405.434483:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787599405.434494:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599405.438889:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599405.438997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522353024 00000100:00100000:3.0:1787599405.439012:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522353024 00000100:00100000:3.0:1787599405.439118:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:3.0:1787599405.439141:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c79c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:11523:x1874433522353024:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787599405.443798:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787599405.443954:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787599405.444050:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.444072:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.444100:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.444111:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.444118:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.444126:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599405.444508:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787599405.444700:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c79c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:11523:x1874433522353024:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 5563us (5829us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787599405.444712:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00000020:00080000:2.0:1787599405.444720:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787599405.447500:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599405.447522:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.447536:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031e00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599405.447541:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.447553:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.447605:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f6c70382b00) 00010000:00010000:1.0:1787599405.447609:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787599405.447615:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.447622:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118322b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599405.447776:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599405.447779:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599405.447781:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599406.049417:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599407.077408:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787599407.124672:0:12495:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787599407.124750:0:12495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787599407.124800:0:12495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787599407.124806:0:12495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787599407.139100:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599407.139131:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543318912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599407.140187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599407.140383:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543318912 00000100:00100000:0.0:1787599407.140392:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543318912 00000100:00100000:0.0:1787599407.140462:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787599407.140473:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874433543318912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599407.140512:0:12105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787599407.140515:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599407.140581:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874433543318912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599407.140590:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787599407.140694:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543318912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599407.292278:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599407.292416:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522353280 00000100:00100000:2.0:1787599407.292427:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522353280 00000100:00100000:2.0:1787599407.292516:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 187 00000100:00100000:2.0:1787599407.292530:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:11542:x1874433522353280:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599407.292562:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599407.292590:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07476 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.292960:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183239 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.292981:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.292997:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183239 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599407.293010:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787599407.293267:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07476 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.293283:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183239 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07476 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.293291:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:2.0:1787599407.293294:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787599407.293297:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031600, rc 0) 00000100:00100000:2.0:1787599407.293362:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:11542:x1874433522353280:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 835us (1097us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787599407.293369:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 187 00000100:00080000:3.0:1787599407.295274:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599407.296924:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.297015:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522353408 00000100:00100000:3.0:1787599407.297031:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522353408 00000100:00100000:3.0:1787599407.297111:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 188 00000100:00100000:3.0:1787599407.297123:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:11542:x1874433522353408:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:3.0:1787599407.297265:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183247 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297290:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297306:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297324:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc674118324e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297333:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc674118324e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297340:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc674118324e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297721:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297730:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297745:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599407.297800:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297817:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297825:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183247 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297845:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183247 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297853:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.297859:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183247 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297867:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183247 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297881:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599407.297884:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599407.297890:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183247 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297896:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183247 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297913:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc674118324e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297926:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc674118324e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297932:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc674118324e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297937:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.297941:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc674118324e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297947:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc674118324e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297954:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c70860500) 00010000:00010000:3.0:1787599407.297957:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599407.297959:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc674118324e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297965:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc674118324e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297985:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297991:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.297997:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.298001:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.298011:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.298017:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.298026:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c70860f00) 00010000:00010000:3.0:1787599407.298029:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599407.298032:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.298038:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599407.298194:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:11542:x1874433522353408:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1071us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599407.298205:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 188 00000100:00100000:3.0:1787599407.354371:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599407.354565:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522353664 00000100:00100000:1.0:1787599407.354577:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522353664 00000100:00100000:1.0:1787599407.354643:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 189 00000100:00100000:1.0:1787599407.354654:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:11545:x1874433522353664:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599407.354677:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599407.354698:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118325c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0747d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.354774:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183263 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.354788:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183263 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.354798:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183263 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.354821:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118326a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.354841:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118326a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.354847:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118326a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355206:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355215:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355222:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599407.355232:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787599407.355325:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183263 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355332:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183263 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355337:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183263 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355342:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599407.355346:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183263 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355362:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183263 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355374:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:1.0:1787599407.355377:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599407.355381:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183263 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355386:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183263 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355396:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118326a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355402:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118326a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355407:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118326a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355412:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599407.355414:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118326a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355418:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118326a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355424:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c50836b00) 00010000:00010000:1.0:1787599407.355426:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599407.355428:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118326a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355443:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118326a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355485:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118325c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0747d expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355497:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0747d expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.355503:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:1.0:1787599407.355506:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599407.355508:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75ddfe00, rc 0) 00000100:00100000:1.0:1787599407.355568:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11545:x1874433522353664:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 915us (1207us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787599407.355575:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 189 00000100:00100000:2.0:1787599407.358027:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.372038:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522353792 00000100:00100000:3.0:1787599407.372361:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522353792 00000100:00100000:2.0:1787599407.381553:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 190 00000100:00100000:2.0:1787599407.381587:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11545:x1874433522353792:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:2.0:1787599407.381673:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc674118327f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.381710:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc674118327f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.381722:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc674118327f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.381756:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc674118327f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.381763:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc674118327f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.381776:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc674118327f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.381783:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599407.381788:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc674118327f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.381797:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc674118327f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.381810:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:2.0:1787599407.381813:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599407.381819:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc674118327f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.381838:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc674118327f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599407.381940:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11545:x1874433522353792:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 370us (23921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599407.381956:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 190 00000100:00100000:2.0:1787599407.394935:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.397254:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522354048 00000100:00100000:3.0:1787599407.397270:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522354048 00000100:00100000:3.0:1787599407.397479:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:3.0:1787599407.397490:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11545:x1874433522354048:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1787599407.397789:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:11545:x1874433522354048:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 299us (2862us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787599407.397798:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:3.0:1787599407.458868:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599407.459002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522354304 00000100:00100000:1.0:1787599407.459019:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522354304 00000100:00100000:1.0:1787599407.459100:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 191 00000100:00100000:1.0:1787599407.459112:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:11070:x1874433522354304:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1787599407.459138:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599407.459191:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183286 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07484 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.459294:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.459308:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0747d expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.459329:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.459377:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0747d expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.459391:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0747d expref: 28 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599407.459404:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543319040:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599407.459503:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599407.463858:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599407.463903:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874433543319040:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599407.463933:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599407.464056:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522354432 00000100:00100000:0.0:1787599407.464065:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522354432 00010000:00010000:0.0:1787599407.464112:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0747d expref: 29 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599407.464187:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:0.0:1787599407.464198:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76165c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:2359:x1874433522354432:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599407.464213:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599407.464221:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0747d expref: 29 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.464233:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0747d expref: 29 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.464254:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183271 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0747d expref: 29 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.464270:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:0.0:1787599407.464274:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.464284:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.464291:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.464330:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599407.464409:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76165c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:2359:x1874433522354432:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 212us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599407.464416:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 72 00010000:00010000:3.0:1787599407.464771:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.464787:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599407.464805:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787599407.464984:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc6741183286 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07484 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.464999:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07484 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.465007:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:3.0:1787599407.465010:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787599407.465012:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75ddea00, rc 0) 00000100:00100000:3.0:1787599407.465060:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:11070:x1874433522354304:12345-192.168.204.30@tcp:101:bash.0 Request processed in 5950us (6206us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787599407.465068:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 191 00000100:00100000:0.0:1787599407.471636:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.471719:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522354688 00000100:00100000:3.0:1787599407.471731:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522354688 00000100:00100000:3.0:1787599407.471797:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 192 00000100:00100000:3.0:1787599407.471808:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:11070:x1874433522354688:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:3.0:1787599407.472093:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.472111:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.472122:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599407.472214:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787599407.472237:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bde7df84 reply state 000000000c3a9ed1 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599407.472246:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787599407.472285:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787599407.472568:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:11070:x1874433522354688:12345-192.168.204.30@tcp:36:bash.0 Request processed in 759us (942us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787599407.472576:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 192 00000020:00080000:3.0:1787599407.472581:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787599407.476279:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:3.0:1787599407.476378:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.476393:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.476400:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.476406:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.476412:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.476419:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.476435:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:3.0:1787599407.476438:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599407.476442:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.476467:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc674118329b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599407.479996:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522354816 00000100:00100000:0.0:1787599407.480015:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522354816 00000100:00100000:0.0:1787599407.480185:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 193 00000100:00100000:0.0:1787599407.480199:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:11070:x1874433522354816:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599407.480229:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599407.480253:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411832a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0748b expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.480314:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411832a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0748b expref: 32 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.480329:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411832a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0748b expref: 32 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.480852:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:0.0:1787599407.480856:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599407.480860:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ffa00, rc 0) 00000100:00100000:0.0:1787599407.480934:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:11070:x1874433522354816:12345-192.168.204.30@tcp:101:bash.0 Request processed in 738us (4663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599407.480940:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 193 00000100:00100000:0.0:1787599407.488505:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599407.488607:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522354944 00000100:00100000:2.0:1787599407.488618:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522354944 00000100:00100000:2.0:1787599407.488693:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:2.0:1787599407.488703:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:11070:x1874433522354944:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1787599407.488722:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599407.488744:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031301335/0xa46cbc67411832a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07492 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599407.488775:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c9a2a, atime: 0x6a8c9a28, ctime: 0x6a8c9a2a, blocks: 0xb 00010000:00010000:2.0:1787599407.488797:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1787599407.488801:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599407.488809:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031301335/0xa46cbc67411832a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07492 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.488838:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031301335/0xa46cbc67411832a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07492 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.488852:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030000, rc 0) 00000100:00100000:2.0:1787599407.488924:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:11070:x1874433522354944:12345-192.168.204.30@tcp:101:bash.0 Request processed in 221us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599407.488931:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00080000:3.0:1787599407.489303:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599407.493308:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599407.493557:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522355072 00000100:00100000:1.0:1787599407.493567:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522355072 00002000:00010000:1.0:1787599407.493682:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787599407.493689:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c76164380 with x1874433522355072 ext(0->18446744073709551615) 00002000:00010000:1.0:1787599407.493702:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c76164380. 00000100:00100000:1.0:1787599407.493737:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:1.0:1787599407.493748:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522355072:12345-192.168.204.30@tcp:10:bash.0 00002000:00010000:1.0:1787599407.498315:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787599407.498325:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787599402 -> 1787599406 00002000:00010000:1.0:1787599407.498500:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787599400 -> 1787599400 00002000:00010000:1.0:1787599407.498502:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787599402 -> 1787599406 00002000:00010000:1.0:1787599407.498505:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787599407.498719:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2359:x1874433522355072:12345-192.168.204.30@tcp:10:bash.0 Request processed in 4963us (5560us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787599407.498732:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00002000:00010000:1.0:1787599407.498738:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787599407.498742:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c76164380 with x1874433522355072 ext(0->18446744073709551615) 00002000:00010000:1.0:1787599407.498752:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c76164380. 00000100:00100000:1.0:1787599407.628448:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.628810:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522355200 00000100:00100000:3.0:1787599407.628867:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522355200 00000100:00100000:3.0:1787599407.629055:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 194 00000100:00100000:3.0:1787599407.629068:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:11559:x1874433522355200:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:3.0:1787599407.629195:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629214:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629226:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629241:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629247:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629253:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629583:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629592:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629745:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599407.629792:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629804:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629811:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629818:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629836:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.629841:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629849:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.629861:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599407.629864:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599407.629869:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630012:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630027:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630039:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630045:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630051:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.630054:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630061:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630069:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c70860f00) 00010000:00010000:3.0:1787599407.630072:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599407.630075:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630081:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630098:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630104:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630110:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630115:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.630124:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630130:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630138:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:3.0:1787599407.630141:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599407.630144:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.630150:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599407.630420:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:11559:x1874433522355200:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1352us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599407.630430:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 194 00000100:00100000:2.0:1787599407.699427:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.699954:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522355456 00000100:00100000:3.0:1787599407.699971:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522355456 00000100:00100000:3.0:1787599407.700112:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 195 00000100:00100000:3.0:1787599407.700126:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+32:11562:x1874433522355456:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599407.700190:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599407.700221:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07499 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.700459:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.700478:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.700517:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.700536:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.700543:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.700549:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.702984:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411832da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.703009:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411832da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.703024:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411832da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599407.703039:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787599407.704306:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704323:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704331:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704337:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.704360:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704369:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704387:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599407.704391:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599407.704396:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704402:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704420:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704426:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704433:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704438:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.704441:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704446:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704454:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c70860f00) 00010000:00010000:3.0:1787599407.704456:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599407.704468:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704474:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704548:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07499 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704565:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411832da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07499 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.704573:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:3.0:1787599407.704575:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787599407.704578:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d200, rc 0) 00000100:00100000:3.0:1787599407.706505:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:11562:x1874433522355456:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 6365us (7078us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787599407.706519:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 195 00000100:00100000:1.0:1787599407.710619:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599407.711957:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522355584 00000100:00100000:0.0:1787599407.711981:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522355584 00000100:00100000:0.0:1787599407.712147:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 196 00000100:00100000:0.0:1787599407.712200:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:11562:x1874433522355584:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:0.0:1787599407.712315:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.712338:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07484 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.712349:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.712430:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07484 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.712450:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07484 expref: 34 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599407.712469:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543319168:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599407.712643:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c81fd40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599407.722878:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.723028:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522355840 00000100:00100000:3.0:1787599407.723042:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522355840 00000100:00100000:3.0:1787599407.723127:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:3.0:1787599407.723141:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:5595:x1874433522355840:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787599407.723647:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+36:5595:x1874433522355840:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 507us (785us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787599407.723657:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:0.0:1787599407.724002:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543319168:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599407.724047:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599407.731223:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599407.731444:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522355968 00000100:00100000:0.0:1787599407.731461:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522355968 00010000:00010000:0.0:1787599407.731521:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07484 expref: 36 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599407.731571:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:0.0:1787599407.731603:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+36:2358:x1874433522355968:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599407.731624:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599407.731633:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07484 expref: 36 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.731649:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07484 expref: 36 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.731678:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddea00/0xa46cbc674118328d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07484 expref: 36 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.731699:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:0.0:1787599407.731705:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.731723:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.731732:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.732354:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599407.732433:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76194700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:2358:x1874433522355968:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 830us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599407.732442:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 73 00010000:00010000:1.0:1787599407.732958:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.732971:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.733013:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.733053:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.733060:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.733067:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599407.733073:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.733099:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.733116:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:1.0:1787599407.733119:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599407.733124:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.733129:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411832e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599407.733415:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:11562:x1874433522355584:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 21216us (22821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599407.733426:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 196 00000100:00100000:2.0:1787599407.738805:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.738918:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522356224 00000100:00100000:3.0:1787599407.738932:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522356224 00000100:00100000:3.0:1787599407.739009:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:3.0:1787599407.739023:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+34:11562:x1874433522356224:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1787599407.739406:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:11562:x1874433522356224:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 383us (614us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787599407.739414:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:0.0:1787599407.749223:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599407.749266:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599407.749317:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.749430:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522356608 00000100:00100000:3.0:1787599407.749443:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522356608 00000100:00100000:1.0:1787599407.749558:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522356480 00000100:00100000:1.0:1787599407.749564:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522356480 00000100:00100000:3.0:1787599407.749565:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 161 00000100:00100000:3.0:1787599407.749576:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2359:x1874433522356608:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599407.749602:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:1.0:1787599407.749687:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522356480:12345-192.168.204.30@tcp:400:kworker.0 00000100:00080000:0.0:1787599407.749759:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599407.749779:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599407.750059:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2359:x1874433522356608:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 480us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599407.750070:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 161 00000100:00100000:2.0:1787599407.750783:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522356352 00000100:00100000:2.0:1787599407.750794:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522356352 00000100:00100000:2.0:1787599407.750872:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 301 00000100:00100000:2.0:1787599407.750883:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2359:x1874433522356352:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599407.752632:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2359:x1874433522356480:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 3009us (3412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599407.752650:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:2.0:1787599407.755345:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2359:x1874433522356352:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 4445us (6058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599407.755368:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 301 00000100:00100000:0.0:1787599407.830398:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.830620:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522356864 00000100:00100000:3.0:1787599407.830636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522356864 00000100:00100000:3.0:1787599407.830723:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 197 00000100:00100000:3.0:1787599407.830737:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+35:11573:x1874433522356864:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:3.0:1787599407.830919:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599407.830950:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.831064:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.831084:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.831096:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.831114:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.831141:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.831149:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.831720:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741183304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.831732:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741183304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.831740:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741183304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599407.833686:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787599407.839115:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839140:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839177:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839184:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599407.839189:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839197:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839220:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:2.0:1787599407.839223:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599407.839229:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839236:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc67411832f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839280:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839286:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839292:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839297:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599407.839300:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839307:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839315:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c70860f00) 00010000:00010000:2.0:1787599407.839318:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599407.839321:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839328:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc67411832fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839408:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc67411832ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a0 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839629:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741183304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a0 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.839669:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:2.0:1787599407.839672:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599407.839675:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d600, rc 0) 00000100:00100000:2.0:1787599407.839787:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+37:11573:x1874433522356864:12345-192.168.204.30@tcp:101:cat.0 Request processed in 9051us (9403us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787599407.839797:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 197 00000100:00100000:1.0:1787599407.848373:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599407.848612:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522357120 00000100:00100000:2.0:1787599407.848626:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522357120 00000100:00100000:2.0:1787599407.848704:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:2.0:1787599407.848717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+37:11573:x1874433522357120:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:2.0:1787599407.849086:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:11573:x1874433522357120:12345-192.168.204.30@tcp:35:cat.0 Request processed in 371us (729us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787599407.849095:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:0.0:1787599407.864085:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.864548:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522357376 00000100:00100000:3.0:1787599407.864566:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522357376 00000100:00100000:3.0:1787599407.864677:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 198 00000100:00100000:3.0:1787599407.864691:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:11574:x1874433522357376:12345-192.168.204.30@tcp:36:rm.0 00010000:00010000:3.0:1787599407.864776:0:8189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787599407.864825:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741183304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a0 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.864856:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc67411832da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07499 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.864870:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411832a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0748b expref: 36 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.864905:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c50836000) 00010000:00010000:3.0:1787599407.864919:0:8189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787599407.864947:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183312 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.864963:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183312 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.864975:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183312 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.864992:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.864999:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.865005:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.865485:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183320 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.865495:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183320 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.865503:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183320 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599407.866252:0:8189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1787599407.866267:0:8189:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365240109423ns, next at 366240105347ns, rc = 0 00010000:00010000:3.0:1787599407.866369:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866383:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866394:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866402:0:8189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866409:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866416:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866434:0:8189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599407.866463:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183320 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866469:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183320 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866475:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183320 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866482:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.866487:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183320 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866495:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183320 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866514:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c70860900) 00010000:00010000:3.0:1787599407.866517:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787599407.866523:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183320 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866530:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183320 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866552:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183312 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866559:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183312 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866566:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183312 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866571:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599407.866574:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183312 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866581:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183312 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866589:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599407.866592:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599407.866595:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183312 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599407.866601:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d800/0xa46cbc6741183312 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599407.866625:0:8189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000327165f7 reply state 00000000a25ce1c2 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599407.866637:0:8189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599407.866753:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+37:11574:x1874433522357376:12345-192.168.204.30@tcp:36:rm.0 Request processed in 2061us (2681us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787599407.866764:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 198 00010000:00010000:2.0:1787599407.868758:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599407.868776:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.868788:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599407.868793:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.868803:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.868838:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f6c70860900) 00010000:00010000:2.0:1787599407.868841:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787599407.869129:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.869136:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066400/0xa46cbc6741183327 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.869194:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599407.869197:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599407.869199:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599407.870672:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.870689:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.870698:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.870704:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599407.870709:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.870718:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.870738:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c70860500) 00010000:00010000:2.0:1787599407.870741:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599407.870745:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.870752:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183319 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599407.917902:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599407.918047:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522357632 00000100:00100000:1.0:1787599407.918061:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522357632 00000100:00100000:1.0:1787599407.918225:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 199 00000100:00100000:1.0:1787599407.918238:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+36:11580:x1874433522357632:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1787599407.918273:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599407.918322:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118332e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074a7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.918727:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde000/0xa46cbc6741183335 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.918748:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde000/0xa46cbc6741183335 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.918763:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde000/0xa46cbc6741183335 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.918779:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.918866:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.918875:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599407.920028:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787599407.920406:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.920433:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.920447:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.920497:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde000/0xa46cbc6741183335 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.920522:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde000/0xa46cbc6741183335 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.920531:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde000/0xa46cbc6741183335 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.920540:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75dde000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599407.920546:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde000/0xa46cbc6741183335 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.920556:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde000/0xa46cbc6741183335 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.920572:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:1.0:1787599407.920575:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599407.920581:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde000/0xa46cbc6741183335 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.920588:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde000/0xa46cbc6741183335 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599407.920616:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068b6fa06 reply state 00000000da275b9e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599407.920629:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787599407.921024:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfa00/0xa46cbc674118332e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a7 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.921046:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a7 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.921071:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c50836200) 00010000:00010000:1.0:1787599407.921075:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599407.921078:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75dde800, rc 0) 00000100:00100000:1.0:1787599407.921342:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:11580:x1874433522357632:12345-192.168.204.30@tcp:101:bash.0 Request processed in 3105us (3454us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787599407.921353:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 199 00000100:00100000:0.0:1787599407.938833:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599407.939479:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522357760 00000100:00100000:2.0:1787599407.939493:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522357760 00000100:00100000:2.0:1787599407.939598:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:2.0:1787599407.939613:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522357760:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1787599407.939640:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599407.939685:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183351 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074ae expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599407.939724:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787599407.939751:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1787599407.939757:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599407.939770:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183351 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ae expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.939795:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183351 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ae expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.939811:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030a00, rc 0) 00000100:00100000:2.0:1787599407.939928:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2357:x1874433522357760:12345-192.168.204.30@tcp:101:bash.0 Request processed in 318us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599407.939937:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00010000:00010000:1.0:1787599407.940609:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.940624:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.940633:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.940640:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddec00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599407.940646:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.940655:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.940674:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c50836b00) 00010000:00010000:1.0:1787599407.940678:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599407.940683:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599407.940691:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddec00/0xa46cbc674118333c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599407.946130:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599407.946314:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522357888 00000100:00100000:0.0:1787599407.946327:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522357888 00000100:00100000:0.0:1787599407.946445:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:0.0:1787599407.946457:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:11580:x1874433522357888:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599407.946480:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599407.946507:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074b5 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.946552:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183351 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ae expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.946562:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599407.946568:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599407.946693:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.946741:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183351 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ae expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.946758:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183351 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ae expref: 7 pid: 6678 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599407.946809:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76092a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874433543319296:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599407.947333:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c81fd40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599407.951546:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599407.951632:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522358016 00000100:00100000:2.0:1787599407.951646:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522358016 00010000:00010000:2.0:1787599407.951708:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183351 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ae expref: 8 pid: 6678 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599407.951798:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:2.0:1787599407.951811:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522358016:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599407.951842:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599407.951875:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183351 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ae expref: 8 pid: 6678 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.951894:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183351 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ae expref: 8 pid: 6678 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.951928:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599407.951933:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599407.951943:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.951954:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599407.952007:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599407.952025:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5816:1874433543319424:192.168.204.30@tcp:105: 00000100:00100000:2.0:1787599407.952147:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c820d2480 going to sleep for 11 seconds 00010000:00010000:0.0:1787599407.953259:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183351 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ae expref: 8 pid: 6678 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599407.953290:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76092a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874433543319296:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599407.953339:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599407.953356:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ffa00, rc 0) 00000100:00100000:0.0:1787599407.953444:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:11580:x1874433522357888:12345-192.168.204.30@tcp:101:bash.0 Request processed in 6987us (7340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599407.953453:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:1.0:1787599407.959355:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599407.959433:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522358272 00000100:00100000:3.0:1787599407.959448:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522358272 00000100:00100000:3.0:1787599407.959527:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:3.0:1787599407.959544:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+38:11580:x1874433522358272:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:2.0:1787599407.959600:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76195180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5816:1874433543319424:192.168.204.30@tcp:105: 00010000:00010000:2.0:1787599407.959777:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599407.959905:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2358:x1874433522358016:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 8095us (8377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599407.959916:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:3.0:1787599407.960112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:11580:x1874433522358272:12345-192.168.204.30@tcp:35:bash.0 Request processed in 572us (772us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787599407.960120:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 55 00010000:00010000:1.0:1787599408.098061:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599408.143824:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599408.144042:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522358400 00000100:00100000:3.0:1787599408.144057:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522358400 00000100:00100000:3.0:1787599408.144737:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 200 00000100:00100000:3.0:1787599408.144754:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+39:11596:x1874433522358400:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599408.144792:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599408.144835:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118335f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074bc expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.144936:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067a00/0xa46cbc6741183366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.144954:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067a00/0xa46cbc6741183366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.144987:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067a00/0xa46cbc6741183366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599408.145074:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787599408.145094:0:8189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599408.145124:0:8189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067a00/0xa46cbc6741183366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.145190:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118335f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074bc expref: 41 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.145215:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067a00/0xa46cbc6741183366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074bc expref: 40 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.145226:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599408.145229:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599408.145233:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c76067a00, rc 0) 00000100:00100000:3.0:1787599408.145324:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+40:11596:x1874433522358400:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 575us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599408.145333:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 200 00000100:00100000:1.0:1787599408.155479:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599408.155746:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522358656 00000100:00100000:2.0:1787599408.155760:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522358656 00000100:00100000:2.0:1787599408.155849:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 201 00000100:00100000:2.0:1787599408.155863:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+40:11596:x1874433522358656:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599408.155895:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599408.155925:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118336d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074c3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.156065:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183374 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.156093:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.156108:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599408.156122:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787599408.156570:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118336d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074c3 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.156595:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074c3 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.156606:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c50836200) 00010000:00010000:2.0:1787599408.156627:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599408.156631:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030a00, rc 0) 00000100:00100000:2.0:1787599408.156764:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+42:11596:x1874433522358656:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 903us (1300us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787599408.156773:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 201 00000100:00100000:1.0:1787599408.168152:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599408.168255:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599408.170908:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522359040 00000100:00100000:2.0:1787599408.170931:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522359040 00000100:00100000:2.0:1787599408.171060:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:2.0:1787599408.171074:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58452050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+42:2358:x1874433522359040:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599408.171096:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599408.171133:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc6741183374 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074c3 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.171200:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c50836200) 00010000:00010000:2.0:1787599408.171207:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599408.171299:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58452050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+41:2358:x1874433522359040:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 229us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599408.171308:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1787599408.171679:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522358912 00000100:00100000:0.0:1787599408.171686:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522358912 00000100:00100000:0.0:1787599408.171737:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 202 00000100:00100000:0.0:1787599408.171746:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+41:11596:x1874433522358912:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599408.171775:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599408.171797:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741183382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074ca expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.171938:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741183389 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.171979:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741183389 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.171992:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741183389 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599408.172007:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787599408.172215:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741183382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ca expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.172233:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741183389 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ca expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.172242:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c50836200) 00010000:00010000:0.0:1787599408.172245:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787599408.172248:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe400, rc 0) 00000100:00100000:0.0:1787599408.172295:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+43:11596:x1874433522358912:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 550us (4040us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787599408.172303:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 202 00000100:00100000:1.0:1787599408.179197:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599408.179319:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522359168 00000100:00100000:2.0:1787599408.179334:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522359168 00000100:00100000:2.0:1787599408.179415:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:2.0:1787599408.179428:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+6:2359:x1874433522359168:12345-192.168.204.30@tcp:1:lfs.0 00010000:00010000:2.0:1787599408.179490:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.179519:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.179553:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599408.179559:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599408.179565:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.179617:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.179635:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 6 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599408.179655:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76194000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874433543319552:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599408.179797:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599408.188314:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76194000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874433543319552:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599408.188362:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599408.190675:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.191137:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522359296 00000100:00100000:0.0:1787599408.191209:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522359296 00002000:00100000:0.0:1787599408.191291:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9f6c75e4d500 x1874433522359296/t0(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:264/0 lens 504/0 e 0 to 0 dl 1787599419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787599408.191304:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c75e4d500 with x1874433522359296 ext(0->8) 00010000:00010000:0.0:1787599408.191318:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 7 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.191565:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 7 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599408.191575:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f6c75e4d500 00000100:00100000:0.0:1787599408.191623:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:0.0:1787599408.191637:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2358:x1874433522359296:12345-192.168.204.30@tcp:4:lfs.0 00000100:00100000:0.0:1787599408.193959:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2358:x1874433522359296:12345-192.168.204.30@tcp:4:lfs.0 Request processed in 2309us (3281us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787599408.193977:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00002000:00100000:0.0:1787599408.193991:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9f6c75e4d500 x1874433522359296/t4294967308(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:264/0 lens 504/448 e 0 to 0 dl 1787599419 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787599408.194003:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c75e4d500 with x1874433522359296 ext(0->8) 00010000:00010000:0.0:1787599408.194017:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 9 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.194043:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 9 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599408.194053:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f6c75e4d500 00000100:00100000:3.0:1787599408.196798:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.197194:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522359424 00000100:00100000:0.0:1787599408.197207:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522359424 00010000:00010000:0.0:1787599408.197266:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 9 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599408.197344:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:0.0:1787599408.197366:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76166300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2359:x1874433522359424:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599408.197387:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787599408.197417:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787599408.197420:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787599406 00002000:00010000:0.0:1787599408.197423:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787599407 00002000:00010000:0.0:1787599408.197425:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787599406 00010000:00010000:0.0:1787599408.197433:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 9 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.197450:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 9 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.197483:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcbb62a5/0xa46cbc6741183358 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074b5 expref: 9 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.197504:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599408.197510:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599408.197517:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.197529:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.197568:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599408.197651:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76166300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522359424:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 296us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599408.197661:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 75 00010000:00010000:2.0:1787599408.197681:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.197696:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.197726:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.197741:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.197750:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.197757:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030a00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599408.197763:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.197773:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.197788:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.197797:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e25a047/0xa46cbc6741183397 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599408.197872:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522359168:12345-192.168.204.30@tcp:1:lfs.0 Request processed in 18446us (18734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599408.197881:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:1.0:1787599408.200256:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599408.200531:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522359680 00000100:00100000:3.0:1787599408.200544:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522359680 00000100:00100000:3.0:1787599408.200885:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:3.0:1787599408.200902:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c7a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+43:11596:x1874433522359680:12345-192.168.204.30@tcp:35:lfs.0 00000004:00010000:3.0:1787599408.201006:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741183389 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ca expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599408.202721:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787599408.202793:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787599408.206349:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787599408.206574:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.206614:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a7 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.206624:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.206680:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a7 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.206702:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a7 expref: 47 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599408.206723:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76194000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1874433543319680:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599408.207621:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7660a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787599408.212717:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599408.212866:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76194000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1874433543319680:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599408.212905:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599408.212988:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522359808 00000100:00100000:0.0:1787599408.213007:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522359808 00010000:00010000:0.0:1787599408.213067:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a7 expref: 48 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599408.213114:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:0.0:1787599408.213124:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+48:2358:x1874433522359808:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599408.213147:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599408.213187:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a7 expref: 48 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.213201:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a7 expref: 48 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.213227:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde800/0xa46cbc6741183343 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074a7 expref: 48 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.213245:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c50836200) 00010000:00010000:0.0:1787599408.213251:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.213261:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.213274:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.213366:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599408.213450:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+47:2358:x1874433522359808:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 325us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599408.213459:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 76 00010000:00010000:2.0:1787599408.216245:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.216267:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599408.216516:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787599408.217281:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787599408.217513:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76194000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874433543319808:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787599408.217842:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599408.217957:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7660a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599408.218310:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543319808 00000100:00100000:0.0:1787599408.218321:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543319808 00000100:00100000:0.0:1787599408.218485:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599408.218499:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874433543319808:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787599408.218655:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874433543319808:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599408.218665:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599408.218863:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76194000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874433543319808:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787599408.219854:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787599408.219974:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76194000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874433543319936:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1787599408.221697:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599408.223287:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599408.223346:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643240 going to sleep for 11 seconds 00000100:00100000:0.0:1787599408.223666:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543319936 00000100:00100000:0.0:1787599408.223681:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543319936 00000100:00100000:0.0:1787599408.223762:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599408.223775:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1874433543319936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787599408.224185:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1874433543319936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 382us (877us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787599408.224196:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599408.224544:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76194000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874433543319936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787599408.224656:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787599408.224723:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.224737:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.224746:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.224754:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599408.224759:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.224768:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.224788:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c50836200) 00010000:00010000:2.0:1787599408.224791:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787599408.224797:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.224837:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc674118339e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787599408.225937:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787599408.226338:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787599408.226355:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365600197222ns, next at 366600193800ns, rc = 0 00000001:00080000:2.0:1787599408.226367:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787599408.226494:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c50836200) 00010000:00010000:2.0:1787599408.226499:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787599408.226511:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc6741183389 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ca expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599408.226697:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c7a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:11596:x1874433522359680:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 25800us (26452us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787599408.226708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00000020:00080000:2.0:1787599408.226715:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787599408.231469:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.231601:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522359936 00000100:00100000:0.0:1787599408.231616:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522359936 00000100:00100000:0.0:1787599408.231702:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 203 00000100:00100000:0.0:1787599408.231715:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+50:11596:x1874433522359936:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599408.231748:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599408.231781:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411833a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074d1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.231897:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411833a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d1 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.231913:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411833a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d1 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.231935:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599408.231938:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599408.231943:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ffa00, rc 0) 00000100:00100000:0.0:1787599408.232016:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:11596:x1874433522359936:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 303us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599408.232024:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 203 00000100:00100000:3.0:1787599408.236589:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.236929:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522360192 00000100:00100000:0.0:1787599408.236945:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522360192 00000100:00100000:0.0:1787599408.237023:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:0.0:1787599408.237036:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+51:11596:x1874433522360192:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:0.0:1787599408.237559:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11596:x1874433522360192:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 523us (983us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787599408.237569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:3.0:1787599408.347776:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.352190:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522360320 00000100:00100000:0.0:1787599408.352213:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522360320 00000100:00100000:0.0:1787599408.352303:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 204 00000100:00100000:0.0:1787599408.352316:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11606:x1874433522360320:12345-192.168.204.30@tcp:34:lfs.0 00010000:00010000:0.0:1787599408.352557:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352611:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352627:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352646:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352653:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352659:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352792:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352801:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352820:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599408.352880:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352895:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352902:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352921:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352928:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599408.352933:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352941:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352957:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:0.0:1787599408.352960:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599408.352966:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352973:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352990:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.352998:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353004:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353009:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599408.353012:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353032:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353041:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c43a07000) 00010000:00010000:0.0:1787599408.353043:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599408.353052:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353058:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353076:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353082:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353089:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353094:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fee00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599408.353097:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353103:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353110:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599408.353112:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599408.353115:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.353130:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599408.353363:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11606:x1874433522360320:12345-192.168.204.30@tcp:34:lfs.0 Request processed in 1044us (5600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599408.354082:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 204 00000100:00100000:1.0:1787599408.431626:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.431754:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522360576 00000100:00100000:0.0:1787599408.431771:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522360576 00000100:00100000:0.0:1787599408.431930:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 205 00000100:00100000:0.0:1787599408.431944:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+52:11609:x1874433522360576:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599408.431974:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599408.432002:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074d8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432124:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432151:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432220:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432237:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432245:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432276:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432470:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432479:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432487:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599408.432498:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787599408.432631:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432640:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432648:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432655:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fea00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599408.432660:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432669:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432683:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:0.0:1787599408.432686:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599408.432699:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432706:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc67411833c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432720:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432726:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432732:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432738:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599408.432741:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432746:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432755:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c43a07000) 00010000:00010000:0.0:1787599408.432757:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599408.432759:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432765:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411833cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432825:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc67411833c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d8 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432860:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d8 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.432869:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599408.432871:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599408.432874:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe000, rc 0) 00000100:00100000:0.0:1787599408.432966:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:11609:x1874433522360576:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1024us (1357us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787599408.432976:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 205 00000100:00100000:2.0:1787599408.440466:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599408.440530:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522360704 00000100:00100000:1.0:1787599408.440560:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522360704 00000100:00100000:1.0:1787599408.440680:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 206 00000100:00100000:1.0:1787599408.440693:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:11609:x1874433522360704:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:1.0:1787599408.440793:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf800/0xa46cbc67411833e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.440826:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf800/0xa46cbc67411833e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.440841:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf800/0xa46cbc67411833e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.440886:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf800/0xa46cbc67411833e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.440919:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf800/0xa46cbc67411833e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.440928:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf800/0xa46cbc67411833e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.440934:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599408.440939:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf800/0xa46cbc67411833e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.440946:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf800/0xa46cbc67411833e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.440961:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:1.0:1787599408.440964:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599408.440971:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf800/0xa46cbc67411833e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.440978:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf800/0xa46cbc67411833e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599408.442994:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:11609:x1874433522360704:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 2289us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.443010:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 206 00000100:00100000:1.0:1787599408.453273:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599408.453375:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522360960 00000100:00100000:3.0:1787599408.453389:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522360960 00000100:00100000:3.0:1787599408.453470:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:3.0:1787599408.453482:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+54:11609:x1874433522360960:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1787599408.454309:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:11609:x1874433522360960:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 819us (1043us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787599408.454322:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:0.0:1787599408.528136:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599408.529699:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522361216 00000100:00100000:2.0:1787599408.529717:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522361216 00000100:00100000:2.0:1787599408.529824:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 207 00000100:00100000:2.0:1787599408.529838:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:11619:x1874433522361216:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1787599408.529876:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599408.529880:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787599408.529919:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067a00/0xa46cbc6741183366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074bc expref: 55 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.529949:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:2.0:1787599408.529985:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599408.530005:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc67411833eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074df expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.530143:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.530222:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d8 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.530234:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.530276:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d8 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.530293:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d8 expref: 55 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599408.530308:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76197800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543320064:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599408.530753:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643240 going to sleep for 11 seconds 00000100:00100000:0.0:1787599408.535618:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76197800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543320064:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599408.535664:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599408.544297:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599408.544951:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522361344 00000100:00100000:2.0:1787599408.544966:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522361344 00010000:00010000:2.0:1787599408.545024:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d8 expref: 56 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599408.545071:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:2.0:1787599408.545084:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+56:2358:x1874433522361344:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599408.545103:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599408.545128:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d8 expref: 56 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.545144:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d8 expref: 56 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.545212:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411833d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d8 expref: 56 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.545235:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:2.0:1787599408.545240:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.545251:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.545259:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.545293:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599408.545372:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:2358:x1874433522361344:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 291us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599408.545380:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00010000:00010000:1.0:1787599408.547442:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.547463:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599408.547511:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787599408.547725:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030200/0xa46cbc67411833eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074df expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.547751:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074df expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.547762:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:1.0:1787599408.547765:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599408.547769:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031c00, rc 0) 00000100:00100000:1.0:1787599408.547858:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:11619:x1874433522361216:12345-192.168.204.30@tcp:101:bash.0 Request processed in 18022us (19737us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787599408.547867:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 207 00000100:00100000:0.0:1787599408.550694:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599408.551011:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522361600 00000100:00100000:3.0:1787599408.551024:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522361600 00000100:00100000:3.0:1787599408.551109:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 208 00000100:00100000:3.0:1787599408.551122:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+55:11619:x1874433522361600:12345-192.168.204.30@tcp:36:bash.0 00010000:00010000:3.0:1787599408.551564:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.551746:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.551763:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599408.551847:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787599408.551877:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c53c0094 reply state 000000002d902561 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599408.551902:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599408.552141:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:11619:x1874433522361600:12345-192.168.204.30@tcp:36:bash.0 Request processed in 1019us (1460us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787599408.552149:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 208 00000020:00080000:3.0:1787599408.552298:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787599408.556416:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.556493:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522361728 00000100:00100000:0.0:1787599408.556508:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522361728 00000100:00100000:0.0:1787599408.556598:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 209 00000100:00100000:0.0:1787599408.556613:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:11619:x1874433522361728:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599408.556649:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599408.556678:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741183407 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074e6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.556799:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.556880:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074df expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.556891:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.556901:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.556976:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.556987:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.556994:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.557002:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599408.557007:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.557016:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.557036:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:3.0:1787599408.557039:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599408.557042:0:3286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.557051:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x54a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.557056:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.557066:0:5832:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:0.0:1787599408.557069:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066c00/0xa46cbc6741183400 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.557116:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074df expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.557134:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074df expref: 58 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599408.557151:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543320192:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599408.557415:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c81fd4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599408.567793:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543320192:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599408.567851:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599408.571818:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.572205:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522361856 00000100:00100000:0.0:1787599408.572220:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522361856 00010000:00010000:0.0:1787599408.572280:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074df expref: 59 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599408.572365:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:0.0:1787599408.572379:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:2358:x1874433522361856:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599408.572412:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599408.572422:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074df expref: 59 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.572438:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074df expref: 59 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.572469:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411833f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074df expref: 59 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.572492:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599408.572497:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.572508:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.572517:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.572560:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599408.572615:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.572625:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599408.572658:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76197800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:2358:x1874433522361856:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 281us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599408.572666:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00000004:00200000:2.0:1787599408.572904:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787599408.572910:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599408.573991:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.574047:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc6741183407 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074e6 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.574998:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074e6 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.575020:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:2.0:1787599408.575024:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599408.575029:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fea00, rc 0) 00000100:00100000:2.0:1787599408.575887:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:11619:x1874433522361728:12345-192.168.204.30@tcp:101:bash.0 Request processed in 19266us (19474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599408.575899:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 209 00000100:00100000:2.0:1787599408.583145:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.583734:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522362112 00000100:00100000:0.0:1787599408.583773:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522362112 00000100:00100000:0.0:1787599408.583880:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:0.0:1787599408.583894:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+57:11619:x1874433522362112:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:0.0:1787599408.584287:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:11619:x1874433522362112:12345-192.168.204.30@tcp:35:bash.0 Request processed in 394us (1155us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787599408.584297:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:0.0:1787599408.650993:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599408.651143:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522362240 00000100:00100000:3.0:1787599408.651352:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522362240 00000100:00100000:3.0:1787599408.651700:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 210 00000100:00100000:3.0:1787599408.651715:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+58:11625:x1874433522362240:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599408.651750:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599408.651780:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc6741183415 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074ed expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.651889:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067000/0xa46cbc674118341c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.651907:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067000/0xa46cbc674118341c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.651922:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067000/0xa46cbc674118341c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599408.652001:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787599408.652005:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599408.652033:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067000/0xa46cbc674118341c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.652067:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc6741183415 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ed expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.652091:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067000/0xa46cbc674118341c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ed expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599408.652102:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:3.0:1787599408.652106:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599408.652111:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c76067000, rc 0) 00000100:00100000:3.0:1787599408.652278:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:11625:x1874433522362240:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 566us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599408.652288:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 210 00000100:00100000:1.0:1787599408.657077:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.657373:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522362368 00000100:00100000:0.0:1787599408.657482:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522362368 00000100:00100000:0.0:1787599408.658197:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 211 00000100:00100000:0.0:1787599408.658217:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:11625:x1874433522362368:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599408.658246:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599408.658277:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183423 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658373:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc674118342a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658405:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc674118342a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658421:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc674118342a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658439:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658447:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658478:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658630:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741183438 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658639:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741183438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658648:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741183438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599408.658695:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787599408.658701:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599408.658724:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741183438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658738:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741183438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658748:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc674118342a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658755:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc674118342a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658763:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc674118342a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658769:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599408.658774:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc674118342a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658790:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc674118342a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658816:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:0.0:1787599408.658820:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599408.658825:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc674118342a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658832:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc674118342a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658849:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658855:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183431 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658861:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658866:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599408.658869:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658875:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658881:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c43a07000) 00010000:00010000:0.0:1787599408.658884:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599408.658887:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183431 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658903:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc6741183431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658941:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183423 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074f4 expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658956:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741183438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074f4 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.658963:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599408.658965:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599408.658968:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fee00, rc 0) 00000100:00100000:0.0:1787599408.659065:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:11625:x1874433522362368:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 854us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599408.659077:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 211 00000100:00100000:0.0:1787599408.663370:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599408.663435:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599408.663589:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522362496 00000100:00100000:1.0:1787599408.663602:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522362496 00000100:00100000:1.0:1787599408.663694:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1787599408.663707:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:2359:x1874433522362496:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599408.663727:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599408.663770:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc6741183438 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074f4 expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.663829:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:1.0:1787599408.663835:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599408.663899:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:2359:x1874433522362496:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 195us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.663907:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:2.0:1787599408.664356:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522362752 00000100:00100000:2.0:1787599408.664365:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522362752 00000100:00100000:2.0:1787599408.664417:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 212 00000100:00100000:2.0:1787599408.664426:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:11625:x1874433522362752:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599408.664448:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599408.664469:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc674118343f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e074fb expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.664734:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.664769:0:8189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074e6 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.664778:0:8189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.664838:0:8189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074e6 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.664857:0:8189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074e6 expref: 60 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599408.664873:0:8189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543320320:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599408.664961:0:8189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599408.669885:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599408.669936:0:8189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543320320:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599408.669974:0:8189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599408.671131:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522362880 00000100:00100000:0.0:1787599408.671148:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522362880 00010000:00010000:0.0:1787599408.671221:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074e6 expref: 61 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599408.671274:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:0.0:1787599408.671287:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76165880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:2358:x1874433522362880:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599408.671306:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599408.671314:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074e6 expref: 61 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.671351:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074e6 expref: 61 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.671379:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fea00/0xa46cbc674118340e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074e6 expref: 61 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.671400:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599408.671406:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.671418:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.671428:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599408.671466:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599408.671557:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76165880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:2358:x1874433522362880:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 272us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599408.671565:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00010000:00010000:2.0:1787599408.671659:0:8189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.671668:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599408.671692:0:8189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787599408.671931:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc674118343f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074fb expref: 61 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.671964:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074fb expref: 60 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.671971:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:2.0:1787599408.671974:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787599408.671976:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031200, rc 0) 00000100:00100000:2.0:1787599408.672008:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:11625:x1874433522362752:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 7583us (8572us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787599408.672015:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 212 00000100:00100000:3.0:1787599408.675575:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599408.675768:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522363136 00000100:00100000:1.0:1787599408.675784:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522363136 00000100:00100000:1.0:1787599408.675918:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1787599408.675933:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58453050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:11625:x1874433522363136:12345-192.168.204.30@tcp:103:lfs.0 00010000:00010000:1.0:1787599408.675956:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599408.675993:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc67411833a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074d1 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.676020:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:1.0:1787599408.676027:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599408.676113:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58453050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:11625:x1874433522363136:12345-192.168.204.30@tcp:103:lfs.0 Request processed in 183us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.676121:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1787599408.683508:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599408.683743:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522363264 00000100:00100000:2.0:1787599408.683757:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522363264 00000100:00100000:2.0:1787599408.683847:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 213 00000100:00100000:2.0:1787599408.683861:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:11625:x1874433522363264:12345-192.168.204.30@tcp:58:lfs.0 00010000:00010000:2.0:1787599408.684267:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.684291:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599408.684305:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599408.695765:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787599408.695944:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:11625:x1874433522363264:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 12078us (12443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599408.695959:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 213 00000100:00100000:3.0:1787599408.699111:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599408.699279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522363392 00000100:00100000:1.0:1787599408.699293:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522363392 00000100:00100000:1.0:1787599408.699372:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 214 00000100:00100000:1.0:1787599408.699386:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+59:11625:x1874433522363392:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599408.699414:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599408.699443:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118345b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07502 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.699546:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.699559:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118345b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07502 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.699585:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.699603:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118345b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07502 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.699621:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:1.0:1787599408.699624:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599408.699628:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118345b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07502 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599408.699637:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75ddee00, rc 0) 00000100:00100000:1.0:1787599408.699725:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:11625:x1874433522363392:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 342us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599408.699733:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 214 00010000:00010000:2.0:1787599409.121412:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599409.187205:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543320448:0@lo:400:kworker.0 00000100:00100000:0.0:1787599409.187318:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599409.187584:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543320576:0@lo:400:kworker.0 00000100:00100000:2.0:1787599409.187631:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599409.187658:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543320448 00000100:00100000:3.0:1787599409.187670:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543320448 00000100:00100000:3.0:1787599409.187819:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787599409.187834:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543320448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599409.187902:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543320448:12345-0@lo:400:kworker.0 Request processed in 71us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599409.187910:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787599409.188177:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543320704:0@lo:400:kworker.0 00000100:00100000:1.0:1787599409.188218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599409.189344:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543320448:0@lo:400:kworker.0 00000100:00100000:0.0:1787599409.189361:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543320960:0@lo:400:kworker.0 00000100:00100000:0.0:1787599409.189419:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599409.189508:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543320576 00000100:00100000:0.0:1787599409.189534:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543320576 00000100:00100000:0.0:1787599409.189598:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543320704 00000100:00100000:0.0:1787599409.189602:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543320704 00000100:00100000:0.0:1787599409.189640:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543320960 00000100:00100000:0.0:1787599409.189643:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543320960 00000100:00100000:0.0:1787599409.189663:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787599409.189671:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543320576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599409.189726:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543320576:12345-0@lo:400:kworker.0 Request processed in 55us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599409.189733:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787599409.189751:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787599409.189756:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543320704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599409.189785:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543320704:12345-0@lo:400:kworker.0 Request processed in 29us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599409.189802:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787599409.189814:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787599409.189820:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543320960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599409.189851:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543320960:12345-0@lo:400:kworker.0 Request processed in 31us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599409.189857:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787599409.189900:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543320960:0@lo:400:kworker.0 00000100:00100000:0.0:1787599409.189956:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543320832:0@lo:400:kworker.0 00000100:00100000:0.0:1787599409.189987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599409.190415:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543320832 00000100:00100000:0.0:1787599409.190421:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543320832 00000100:00100000:0.0:1787599409.190461:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599409.190470:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1874433543320832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599409.190525:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1874433543320832:12345-0@lo:400:kworker.0 Request processed in 56us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599409.190532:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599409.190570:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543320832:0@lo:400:kworker.0 00000100:00080000:0.0:1787599409.190616:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599409.190623:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599409.191535:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543320576:0@lo:400:kworker.0 00000100:00100000:2.0:1787599409.191550:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543321088:0@lo:400:kworker.0 00000100:00100000:2.0:1787599409.191620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599409.191750:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543320704:0@lo:400:kworker.0 00000100:00100000:1.0:1787599409.191759:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543321216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599409.191816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599409.191893:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543321216 00000100:00100000:1.0:1787599409.191899:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543321216 00000100:00100000:1.0:1787599409.191945:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787599409.191954:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543321216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599409.191982:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599409.192036:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543321216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599409.192043:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787599409.192087:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543321216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599409.192916:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543321088 00000100:00100000:0.0:1787599409.192924:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543321088 00000100:00100000:0.0:1787599409.193230:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787599409.193243:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1874433543321088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599409.193345:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1874433543321088:12345-0@lo:400:kworker.0 Request processed in 104us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599409.193352:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787599409.193443:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543321088:0@lo:400:kworker.0 00000040:00080000:0.0:1787599409.571388:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599409.571405:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599409.571458:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787599409.571467:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599409.571676:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c759b3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543321344:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599409.571838:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c81fd4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599409.578792:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c759b3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543321344:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599409.580853:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599409.587348:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522363520 00000100:00100000:2.0:1787599409.587371:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522363520 00000100:00080000:0.0:1787599409.587567:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599409.587596:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 215 00000100:00100000:2.0:1787599409.587611:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:11626:x1874433522363520:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787599409.587909:0:8189:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787599409.588481:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:11626:x1874433522363520:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 868us (7638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599409.588495:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 215 00000100:00100000:3.0:1787599409.593749:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599409.593906:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522363648 00000100:00100000:1.0:1787599409.593921:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522363648 00000100:00100000:1.0:1787599409.594001:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 216 00000100:00100000:1.0:1787599409.594015:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:11626:x1874433522363648:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787599409.594123:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183462 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594146:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183462 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594366:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183462 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594388:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183469 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594396:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183469 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594427:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183469 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594537:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594548:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594556:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599409.594609:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787599409.594615:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599409.594633:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594645:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183462 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594652:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183462 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594660:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183462 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594667:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddfe00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599409.594672:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183462 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594681:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183462 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594825:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:1.0:1787599409.594830:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599409.594836:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183462 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594844:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183462 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594859:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183469 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594866:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183469 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594872:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183469 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594878:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599409.594881:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183469 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594888:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183469 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594897:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9f6c50836b00) 00010000:00010000:1.0:1787599409.594900:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599409.594903:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183469 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594910:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183469 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594937:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594945:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594950:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594955:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75dde200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599409.594958:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594964:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594971:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:1.0:1787599409.594973:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599409.594977:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.594983:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde200/0xa46cbc6741183470 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599409.595140:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:11626:x1874433522363648:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 1123us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599409.595150:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 216 00000100:00100000:1.0:1787599409.607049:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.607284:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522363904 00000100:00100000:0.0:1787599409.607300:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522363904 00000100:00100000:0.0:1787599409.607385:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 217 00000100:00100000:0.0:1787599409.607398:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+60:11626:x1874433522363904:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599409.607467:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599409.607498:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183477 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07509 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.607645:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118347e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.607663:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118347e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.607677:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118347e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599409.607691:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787599409.607845:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118347e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.607854:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118347e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.607862:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118347e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.607869:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599409.607880:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118347e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.607889:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118347e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.607904:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599409.607914:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787599409.607920:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118347e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.607927:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc674118347e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.609240:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183477 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07509 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.609265:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:0.0:1787599409.609269:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599409.609276:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc6741183477 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07509 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.609307:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ffe00, rc 0) 00000100:00100000:0.0:1787599409.609861:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:11626:x1874433522363904:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 2461us (2824us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1787599409.609876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 217 00000100:00100000:1.0:1787599409.614018:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.614220:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522364032 00000100:00100000:0.0:1787599409.614235:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522364032 00000100:00100000:0.0:1787599409.614296:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 218 00000100:00100000:0.0:1787599409.614307:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:11626:x1874433522364032:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787599409.614354:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787599409.614883:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:11626:x1874433522364032:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 573us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599409.614892:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 218 00000100:00100000:1.0:1787599409.619836:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.623256:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522364288 00000100:00100000:0.0:1787599409.623306:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522364288 00000100:00100000:0.0:1787599409.623488:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 219 00000100:00100000:0.0:1787599409.623504:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:11626:x1874433522364288:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599409.623533:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599409.623536:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787599409.623574:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067000/0xa46cbc674118341c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074ed expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.623601:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:0.0:1787599409.623607:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599409.623625:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc674118348c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07510 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599409.632594:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787599409.632970:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.637627:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.637651:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.637832:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffe00/0xa46cbc674118348c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07510 expref: 63 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.637860:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07510 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.637870:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c50836b00) 00010000:00010000:1.0:1787599409.637874:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599409.637879:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75ddfe00, rc 0) 00000100:00100000:1.0:1787599409.637986:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+62:11626:x1874433522364288:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 14485us (18165us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787599409.637997:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 219 00000100:00100000:1.0:1787599409.647694:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.647923:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522364544 00000100:00100000:0.0:1787599409.647937:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522364544 00000100:00100000:0.0:1787599409.648078:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 220 00000100:00100000:0.0:1787599409.648092:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+62:11626:x1874433522364544:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599409.648222:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599409.648262:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddfe00/0xa46cbc6741183493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07510 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.648288:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c50836b00) 00010000:00010000:0.0:1787599409.648302:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599409.648333:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411834a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.648351:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411834a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.648387:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411834a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649476:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1fab1b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649497:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1fab1b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649510:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1fab1b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649635:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411834a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649644:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411834a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649651:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411834a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649658:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599409.649663:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411834a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649671:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411834a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649683:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:1.0:1787599409.649686:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599409.649691:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411834a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649697:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe800/0xa46cbc67411834a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649711:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1fab1b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649717:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1fab1b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649723:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1fab1b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649738:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599409.649742:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1fab1b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649747:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1fab1b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649756:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1fab1b39 (ffff9f6c50836f00) 00010000:00010000:1.0:1787599409.649759:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599409.649762:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1fab1b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.649768:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1fab1b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599409.649917:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:11626:x1874433522364544:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 1822us (2232us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599409.649928:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 220 00000100:00100000:2.0:1787599409.653816:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.653896:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522364672 00000100:00100000:0.0:1787599409.653910:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522364672 00000100:00100000:0.0:1787599409.653982:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 221 00000100:00100000:0.0:1787599409.653993:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+61:11626:x1874433522364672:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599409.654017:0:8189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599409.654043:0:8189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411834af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07517 expref: -99 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.654098:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.654112:0:8189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.654124:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.654470:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe200/0xa46cbc67411834af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07517 expref: 63 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.654490:0:8189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07517 expref: 62 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.654499:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:0.0:1787599409.654502:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787599409.654513:0:8189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe000, rc 0) 00000100:00100000:0.0:1787599409.654618:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+62:11626:x1874433522364672:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 627us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599409.654627:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 221 00000100:00100000:3.0:1787599409.669274:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599409.669507:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522364928 00000100:00100000:2.0:1787599409.669521:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522364928 00000100:00100000:2.0:1787599409.669589:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 222 00000100:00100000:2.0:1787599409.669600:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+62:11626:x1874433522364928:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787599409.669692:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.669710:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.669722:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599409.670003:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787599409.670013:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367043855752ns, next at 368043852874ns, rc = 0 00000004:00010000:2.0:1787599409.670110:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000836d8ab2 reply state 000000008bf2e437 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599409.670119:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599409.670263:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+64:11626:x1874433522364928:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 664us (997us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787599409.670270:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 222 00000100:00100000:3.0:1787599409.676869:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599409.677067:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522365056 00000100:00100000:1.0:1787599409.677079:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522365056 00000100:00100000:1.0:1787599409.677144:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 223 00000100:00100000:1.0:1787599409.677189:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+64:11626:x1874433522365056:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599409.677216:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599409.677244:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0751e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.677312:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0751e expref: 65 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.677346:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0751e expref: 65 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.677364:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:1.0:1787599409.677367:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599409.677371:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75ddf200, rc 0) 00000100:00100000:1.0:1787599409.677418:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+65:11626:x1874433522365056:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 265us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599409.677425:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 223 00010000:00010000:2.0:1787599409.678007:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.678018:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.678031:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.678038:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599409.678043:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.678055:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.678069:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:2.0:1787599409.678072:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787599409.678075:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.678092:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599409.682686:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.682791:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522365184 00000100:00100000:0.0:1787599409.682802:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522365184 00000100:00100000:0.0:1787599409.682880:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:0.0:1787599409.682893:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2358:x1874433522365184:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787599409.683243:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599409.683462:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:2358:x1874433522365184:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 571us (784us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787599409.683471:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:3.0:1787599409.690261:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.690369:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522365440 00000100:00100000:0.0:1787599409.690381:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522365440 00000100:00100000:0.0:1787599409.690444:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:0.0:1787599409.690455:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+64:11626:x1874433522365440:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787599409.690728:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+65:11626:x1874433522365440:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 273us (477us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787599409.690736:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:2.0:1787599409.697557:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.697672:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522365696 00000100:00100000:0.0:1787599409.697682:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522365696 00000100:00100000:0.0:1787599409.697807:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 224 00000100:00100000:0.0:1787599409.697820:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+65:11626:x1874433522365696:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787599409.697950:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+65:11626:x1874433522365696:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 133us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599409.697958:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 224 00000100:00100000:1.0:1787599409.701409:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599409.701552:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522365824 00000100:00100000:2.0:1787599409.701562:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522365824 00000100:00100000:2.0:1787599409.701673:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 225 00000100:00100000:2.0:1787599409.701684:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+65:11626:x1874433522365824:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599409.701705:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599409.701727:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07525 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.701810:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411834d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.701826:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411834d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.701837:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411834d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599409.702042:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599409.702077:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411834d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.702114:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc67411834cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07525 expref: 67 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.702136:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411834d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07525 expref: 66 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.702214:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:2.0:1787599409.702217:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787599409.702221:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031c00, rc 0) 00000100:00100000:2.0:1787599409.702278:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+66:11626:x1874433522365824:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 595us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599409.702286:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 225 00000100:00100000:3.0:1787599409.708061:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599409.708214:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522365952 00000100:00100000:2.0:1787599409.708224:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522365952 00000100:00100000:2.0:1787599409.708285:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:2.0:1787599409.708296:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+10:2359:x1874433522365952:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599409.708316:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599409.708337:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048a08234/0xa46cbc67411834d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0752c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599409.708366:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9a30, blocks: 0x1 00010000:00010000:2.0:1787599409.708386:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=367s v=(0 0) 00010000:00010000:2.0:1787599409.708391:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599409.708400:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048a08234/0xa46cbc67411834d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0752c expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.708417:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000048a08234/0xa46cbc67411834d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0752c expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.708429:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030e00, rc 0) 00000100:00100000:2.0:1787599409.708504:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+11:2359:x1874433522365952:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 210us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599409.708512:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:1.0:1787599409.711599:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599409.711830:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522366208 00000100:00100000:2.0:1787599409.711842:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522366208 00000100:00100000:2.0:1787599409.711901:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 226 00000100:00100000:2.0:1787599409.711911:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+66:11626:x1874433522366208:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787599409.712024:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+66:11626:x1874433522366208:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 105us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599409.712032:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 226 00000100:00100000:1.0:1787599409.730057:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.730211:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522366336 00000100:00100000:0.0:1787599409.730223:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522366336 00000100:00100000:0.0:1787599409.730330:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:0.0:1787599409.730342:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+11:11626:x1874433522366336:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599409.730361:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599409.730381:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07533 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.730416:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000048a08234/0xa46cbc67411834d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0752c expref: 12 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.730426:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599409.730430:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599409.730436:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.730472:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000048a08234/0xa46cbc67411834d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0752c expref: 12 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.730487:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000048a08234/0xa46cbc67411834d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0752c expref: 12 pid: 6678 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599409.730502:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c759b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874433543321472:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599409.731039:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c81fd4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599409.735473:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.735697:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c759b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874433543321472:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599409.735737:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.735777:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe200, rc 0) 00000100:00100000:1.0:1787599409.735792:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522366464 00000100:00100000:1.0:1787599409.735802:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522366464 00000100:00100000:0.0:1787599409.735858:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:11626:x1874433522366336:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 5518us (5812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599409.735867:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00010000:00010000:1.0:1787599409.735917:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000048a08234/0xa46cbc67411834d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0752c expref: 12 pid: 6678 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599409.736049:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:1.0:1787599409.736060:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:2358:x1874433522366464:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599409.736074:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599409.736098:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000048a08234/0xa46cbc67411834d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0752c expref: 12 pid: 6678 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.736112:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000048a08234/0xa46cbc67411834d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0752c expref: 12 pid: 6678 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.736666:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048a08234/0xa46cbc67411834d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0752c expref: 12 pid: 6678 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.736689:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599409.736694:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599409.736704:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.736715:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.736761:0:8431:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599409.736778:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8431:1874433543321600:192.168.204.30@tcp:105: 00000100:00100000:1.0:1787599409.736911:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b467b0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599409.742826:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8431:1874433543321600:192.168.204.30@tcp:105: 00010000:00010000:1.0:1787599409.743282:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599409.743504:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+11:2358:x1874433522366464:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 7443us (8037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599409.743515:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:2.0:1787599409.744502:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599409.744557:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522366592 00000100:00100000:1.0:1787599409.744567:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522366592 00002000:00100000:1.0:1787599409.744626:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9f6c75fe6a00 x1874433522366592/t0(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:265/0 lens 504/0 e 0 to 0 dl 1787599420 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599409.744650:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c75fe6a00 with x1874433522366592 ext(0->12) 00002000:00010000:1.0:1787599409.744656:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c75fe6a00 00000100:00100000:1.0:1787599409.744689:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1787599409.744699:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+11:2359:x1874433522366592:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787599409.746475:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:2359:x1874433522366592:12345-192.168.204.30@tcp:4:lhsmtool_posix.0 Request processed in 1768us (1967us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787599409.746489:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00002000:00100000:1.0:1787599409.746500:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9f6c75fe6a00 x1874433522366592/t4294967320(0) o4->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:265/0 lens 504/448 e 0 to 0 dl 1787599420 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787599409.746510:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c75fe6a00 with x1874433522366592 ext(0->12) 00002000:00010000:1.0:1787599409.746516:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c75fe6a00 00000100:00100000:2.0:1787599409.751659:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599409.751827:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522366720 00000100:00100000:1.0:1787599409.751837:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522366720 00000100:00100000:1.0:1787599409.751900:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 227 00000100:00100000:1.0:1787599409.751909:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+66:11626:x1874433522366720:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787599409.809991:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1787599409.810133:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1787599409.810153:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787599409.810192:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787599409.810217:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f6c7660a9c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787599409.810223:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c75b63300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c5352ae40 00000020:00080000:0.0:1787599409.810226:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c75b63b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c58bb1400 00000004:00080000:0.0:1787599409.810268:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787599409.810292:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f6c70849a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787599409.810294:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c75d94c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c4819db40 00000020:00080000:0.0:1787599409.810296:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c75d94e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c5b22c800 00000020:00080000:1.0:1787599409.810407:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787599409.810643:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787599409.810767:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599409.810801:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543321728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787599409.810877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599409.811391:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543321856:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787599409.811437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599409.811468:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599409.811473:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543321984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787599409.811495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599409.811601:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543321728 00000100:00100000:3.0:1787599409.811610:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543321728 00000100:00100000:3.0:1787599409.811664:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543321856 00000100:00100000:3.0:1787599409.811668:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543321856 00000100:00100000:3.0:1787599409.811681:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543321984 00000100:00100000:3.0:1787599409.811684:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543321984 00000100:00100000:3.0:1787599409.811697:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787599409.811722:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543321728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787599409.811751:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787599409.811799:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c9a2e, atime: 0x6a8c9a2f, ctime: 0x6a8c9a2e, blocks: 0x1 00010000:00010000:3.0:1787599409.811808:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb8cbac/0xa46cbc67411834e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.811823:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1787599409.811828:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599409.811835:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb8cbac/0xa46cbc67411834e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.811850:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcb8cbac/0xa46cbc67411834e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.811858:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb8cbac/0xa46cbc67411834e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.811866:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb8cbac/0xa46cbc67411834e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.811884:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787599409.812856:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3301:x1874433543321728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1132us (1975us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787599409.812866:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787599409.812892:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787599409.812901:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1874433543321856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787599409.812930:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1787599409.812947:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.812966:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031301335/0xa46cbc67411832a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07492 expref: 12 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.812973:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787599409.812977:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599409.812981:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.813012:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031301335/0xa46cbc67411832a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07492 expref: 12 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.813027:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031301335/0xa46cbc67411832a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07492 expref: 12 pid: 6678 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599409.813040:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76166300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1874433543322112:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599409.813110:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f780 going to sleep for 11 seconds 00010000:00010000:3.0:1787599409.813134:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599409.813141:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcb8cbac/0xa46cbc67411834e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.813150:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599409.813174:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb8cbac/0xa46cbc67411834e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.813193:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb8cbac/0xa46cbc67411834e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599409.813340:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787599409.813352:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c764d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3299:x1874433543321984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787599409.813487:0:11786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787599409.813497:0:11786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787599408 00002000:00010000:1.0:1787599409.813499:0:11786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787599409.813502:0:11786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787599408 -> 1787599408 00002000:00010000:1.0:1787599409.813504:0:11786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787599409.813549:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c764d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3299:x1874433543321984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (2052us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787599409.813556:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1787599409.813676:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c76165f80/2, rc 0, transno 4294967321 00000100:00100000:1.0:1787599409.813683:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543321984:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787599409.813852:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcb8cbac/0xa46cbc67411834e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.813862:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcb8cbac/0xa46cbc67411834e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.813882:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599409.813884:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599409.813886:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787599409.814015:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c750fbb80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787599409.814021:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543321728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787599409.815148:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:11626:x1874433522366720:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 63234us (63494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599409.815180:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 227 00000100:00100000:2.0:1787599409.819186:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599409.819335:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522366848 00000100:00100000:1.0:1787599409.819348:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522366848 00000100:00100000:1.0:1787599409.819408:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:1.0:1787599409.819428:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+13:2359:x1874433522366848:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787599409.821436:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599409.821468:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522366976 00000100:00100000:3.0:1787599409.821475:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522366976 00010000:00010000:3.0:1787599409.821511:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031301335/0xa46cbc67411832a9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07492 expref: 14 pid: 6678 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599409.821550:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:3.0:1787599409.821559:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76165880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:2356:x1874433522366976:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599409.821572:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599409.821578:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031301335/0xa46cbc67411832a9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07492 expref: 14 pid: 6678 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.821606:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031301335/0xa46cbc67411832a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07492 expref: 14 pid: 6678 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.821634:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599409.821638:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599409.821645:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.821655:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.821677:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599409.821727:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76165880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+14:2356:x1874433522366976:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 169us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599409.821735:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 81 00010000:00010000:0.0:1787599409.821995:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031301335/0xa46cbc67411832a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07492 expref: 13 pid: 6678 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599409.822029:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76166300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1874433543322112:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599409.822051:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.822061:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.822068:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.822077:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.822083:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.822106:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787599409.822749:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3299:x1874433543321856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9848us (11309us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787599409.822758:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1787599409.823104:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599409.823111:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.823121:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067e00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599409.823126:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.823135:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.823188:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.823197:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411834ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787599409.823339:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c76166a00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787599409.823346:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543321856:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787599409.823493:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599409.823496:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599409.823497:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599409.863232:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+12:2359:x1874433522366848:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 43804us (44075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599409.863246:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00000001:00080000:2.0:1787599409.863383:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1787599409.863398:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1787599409.863403:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1787599409.877045:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599409.878443:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522367232 00000100:00100000:2.0:1787599409.878456:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522367232 00000100:00100000:0.0:1787599409.878809:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 228 00000100:00100000:0.0:1787599409.878824:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:11626:x1874433522367232:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599409.878882:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599409.878923:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031c00/0xa46cbc67411834d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07525 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.878948:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:0.0:1787599409.878953:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599409.878995:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.879010:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.879021:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599409.879994:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050863fd5 reply state 0000000089309661 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599409.880008:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599409.880314:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:11626:x1874433522367232:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 1490us (3280us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787599409.880323:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 228 00010000:00010000:3.0:1787599409.883061:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.883080:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.883087:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.883093:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599409.883098:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.883106:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.883124:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:3.0:1787599409.883127:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599409.883148:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599409.883444:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599409.885593:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522367360 00000100:00100000:2.0:1787599409.885605:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522367360 00000100:00100000:2.0:1787599409.885674:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:2.0:1787599409.885701:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2356:x1874433522367360:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787599409.886080:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787599409.886084:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787599408 -> 1787599407 00002000:00010000:2.0:1787599409.886101:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787599407 00002000:00010000:2.0:1787599409.886104:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787599408 -> 1787599407 00002000:00010000:2.0:1787599409.886107:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787599409.886271:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2356:x1874433522367360:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 581us (2830us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787599409.886284:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00010000:00010000:3.0:1787599409.886847:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe400/0xa46cbc67411834f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599409.891072:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599409.891200:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522367616 00000100:00100000:2.0:1787599409.891211:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522367616 00000100:00100000:2.0:1787599409.891287:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 229 00000100:00100000:2.0:1787599409.891297:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:11626:x1874433522367616:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787599409.891371:0:8189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.891388:0:8189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07517 expref: 20 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.891398:0:8189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.891431:0:8189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07517 expref: 20 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.891444:0:8189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07517 expref: 20 pid: 8189 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599409.891459:0:8189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543322240:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599409.891551:0:8189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5aae5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599409.896392:0:8189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8189:1874433543322240:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599409.896424:0:8189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599409.898316:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599409.898587:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522367744 00000100:00100000:2.0:1787599409.898729:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522367744 00010000:00010000:2.0:1787599409.898773:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07517 expref: 21 pid: 8189 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599409.898829:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 82 00000100:00100000:2.0:1787599409.898839:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:2358:x1874433522367744:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599409.898857:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599409.899129:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07517 expref: 21 pid: 8189 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.899143:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07517 expref: 21 pid: 8189 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.899334:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fe000/0xa46cbc67411834b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07517 expref: 21 pid: 8189 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.899363:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:2.0:1787599409.899370:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.900043:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.900050:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.900095:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599409.900206:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:2358:x1874433522367744:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 1366us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599409.900232:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 82 00010000:00010000:0.0:1787599409.900899:0:8189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.900910:0:8189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.900949:0:8189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.900956:0:8189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.900963:0:8189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.900971:0:8189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599409.900975:0:8189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.900982:0:8189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.900995:0:8189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:0.0:1787599409.900998:0:8189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787599409.901001:0:8189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.901007:0:8189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411834fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599409.901072:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:11626:x1874433522367616:12345-192.168.204.30@tcp:55:lhsmtool_posix.0 Request processed in 9775us (10008us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787599409.901081:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 229 00000100:00100000:1.0:1787599409.906986:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.907117:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522367872 00000100:00100000:0.0:1787599409.907127:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522367872 00000100:00100000:0.0:1787599409.907478:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:0.0:1787599409.907504:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522367872:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787599409.907548:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.907569:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.907578:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599409.907583:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599409.907587:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.907621:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.907634:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 8 pid: 6679 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599409.908938:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75dc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1874433543322368:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599409.910290:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c43e8c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787599409.916910:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75dc8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1874433543322368:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599409.917513:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599409.920114:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599409.920808:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522368000 00000100:00100000:3.0:1787599409.920819:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522368000 00010000:00010000:3.0:1787599409.920870:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 9 pid: 6679 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599409.920914:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 83 00000100:00100000:3.0:1787599409.920925:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+9:2358:x1874433522368000:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599409.920939:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599409.920963:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 9 pid: 6679 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.920978:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 9 pid: 6679 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.921002:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026598d91/0xa46cbc67411834e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07533 expref: 9 pid: 6679 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.921020:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599409.921037:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787599409.921042:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.921052:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.921097:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599409.921201:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522368000:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 278us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599409.921210:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 83 00010000:00010000:0.0:1787599409.921351:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.921360:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.921384:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.921397:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.921404:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.921410:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:0.0:1787599409.921415:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.921422:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.921433:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599409.921439:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c81cab8/0xa46cbc6741183503 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599409.921482:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2359:x1874433522367872:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 13981us (14505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599409.921489:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 70 00000100:00100000:1.0:1787599409.927259:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599409.927391:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522368256 00000100:00100000:3.0:1787599409.927401:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522368256 00000100:00100000:3.0:1787599409.927458:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 230 00000100:00100000:3.0:1787599409.927467:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:11626:x1874433522368256:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787599409.927543:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118350a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.927561:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118350a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.927572:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118350a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.927811:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.927822:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0751e expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.927844:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.928061:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0751e expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.928077:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0751e expref: 20 pid: 5833 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599409.928093:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76167480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543322496:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599409.928683:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7086f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599409.947594:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599409.947683:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522368384 00000100:00100000:1.0:1787599409.947695:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522368384 00010000:00010000:1.0:1787599409.947740:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834c4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0751e expref: 21 pid: 5833 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599409.947813:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:1.0:1787599409.947825:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:2358:x1874433522368384:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599409.947841:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599409.947850:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834c4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0751e expref: 21 pid: 5833 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.947868:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0751e expref: 21 pid: 5833 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.947891:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:1.0:1787599409.947897:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.947907:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.947913:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.947932:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599409.948035:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:2358:x1874433522368384:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 211us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599409.948043:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 84 00010000:00010000:0.0:1787599409.952423:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc67411834c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0751e expref: 20 pid: 5833 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599409.952486:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76167480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543322496:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599409.952518:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.952658:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.952667:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599409.952874:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787599409.953022:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787599409.953077:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787599409.953268:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543322624:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787599409.953334:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599409.953375:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98000 going to sleep for 11 seconds 00000100:00100000:3.0:1787599409.953493:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543322624 00000100:00100000:3.0:1787599409.953501:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543322624 00000100:00100000:3.0:1787599409.953561:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787599409.953572:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1874433543322624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787599409.953648:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1874433543322624:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599409.953655:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599409.953766:0:5831:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1787599409.953772:0:5831:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1787599409.953796:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c76165f80, transno 4294967321 00000100:00100000:2.0:1787599409.953812:0:5831:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9f6c76166a00 x1874433543321856/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787599425 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599409.953823:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543322624:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787599409.955224:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787599409.955295:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543322752:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787599409.955346:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599409.955381:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599409.956214:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543322752 00000100:00100000:3.0:1787599409.956223:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543322752 00000100:00100000:3.0:1787599409.956269:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599409.956278:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1874433543322752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787599409.956490:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5831:x1874433543322752:12345-0@lo:1000:mdt00_000.0 Request processed in 212us (1142us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787599409.956497:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599409.960037:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5831:1874433543322752:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787599409.960274:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960306:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960314:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960320:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599409.960325:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960331:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960347:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c43a07000) 00010000:00010000:2.0:1787599409.960350:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599409.960355:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960362:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067e00/0xa46cbc6741183511 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960404:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960411:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960417:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960422:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599409.960434:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960441:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960450:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:2.0:1787599409.960452:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599409.960459:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118345b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07502 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960469:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118345b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07502 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960478:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118345b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07502 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599409.960521:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118345b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07502 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599409.960537:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543322880:192.168.204.30@tcp:105: 00000100:00100000:2.0:1787599409.960756:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599409.964833:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874433543322880:192.168.204.30@tcp:105: 00010000:00010000:3.0:1787599409.964880:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.964892:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031000/0xa46cbc6741183454 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.964928:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183518 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.964942:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183518 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.964954:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183518 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.964964:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183518 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.964971:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183518 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.964977:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183518 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.964983:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599409.964987:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183518 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.964993:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183518 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.965003:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:3.0:1787599409.965006:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599409.965018:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183518 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.965024:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183518 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.965036:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118350a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.965432:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118350a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.965442:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118350a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.965448:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599409.965451:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118350a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.965458:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118350a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.965468:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:3.0:1787599409.965470:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599409.965473:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118350a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.965480:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118350a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599409.967588:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+23:11626:x1874433522368256:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 40111us (40329us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1787599409.967601:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 230 00000020:00080000:3.0:1787599409.967619:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787599409.967848:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599409.967854:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599409.968850:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787599409.968920:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787599409.973355:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599409.974811:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599409.976560:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522368640 00000100:00100000:0.0:1787599409.976573:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522368640 00000100:00100000:3.0:1787599409.976787:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522368768 00000100:00100000:3.0:1787599409.976792:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522368768 00000100:00100000:3.0:1787599409.976817:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:3.0:1787599409.976826:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+24:11626:x1874433522368640:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787599409.977485:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787599409.978331:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787599409.978383:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.978401:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.978411:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.978421:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.978427:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.978434:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599409.978459:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599409.978633:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599409.978640:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.978660:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599409.978664:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.978672:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.978738:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f6c70860000) 00010000:00010000:1.0:1787599409.978741:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787599409.978746:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.978751:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066800/0xa46cbc674118351f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599409.978769:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599409.978771:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599409.978772:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599409.978864:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11626:x1874433522368640:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 2036us (5516us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787599409.978874:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00000020:00080000:3.0:1787599409.978878:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787599409.978899:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:3.0:1787599409.978918:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c7b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+25:11625:x1874433522368768:12345-192.168.204.30@tcp:49:lfs.0 00000100:00100000:3.0:1787599409.978997:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c7b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+25:11625:x1874433522368768:12345-192.168.204.30@tcp:49:lfs.0 Request processed in 84us (4193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599409.979003:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:1.0:1787599409.987225:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599409.988450:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522369024 00000100:00100000:3.0:1787599409.988463:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522369024 00000100:00100000:3.0:1787599409.988639:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 231 00000100:00100000:3.0:1787599409.988651:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+25:11625:x1874433522369024:12345-192.168.204.30@tcp:58:lfs.0 00000040:00080000:3.0:1787599409.988929:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787599409.989409:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+25:11625:x1874433522369024:12345-192.168.204.30@tcp:58:lfs.0 Request processed in 759us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599409.989419:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 231 00000100:00100000:1.0:1787599410.029870:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599410.031655:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522369152 00000100:00100000:2.0:1787599410.031670:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522369152 00000100:00100000:2.0:1787599410.031747:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 232 00000100:00100000:2.0:1787599410.031758:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+25:11628:x1874433522369152:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599410.031791:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599410.031828:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183526 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0753a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.031894:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc674118352d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.031908:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc674118352d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.031920:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc674118352d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.031935:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183534 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.031943:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.031949:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.032285:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.032298:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074fb expref: 26 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.032306:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.032342:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074fb expref: 26 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.032367:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074fb expref: 26 pid: 8189 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599410.032382:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543323008:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599410.032498:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599410.037363:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599410.037443:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522369408 00000100:00100000:1.0:1787599410.037453:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522369408 00000100:00100000:1.0:1787599410.037512:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:1.0:1787599410.037521:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:5596:x1874433522369408:12345-192.168.204.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787599410.037807:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:5596:x1874433522369408:12345-192.168.204.30@tcp:35:ldlm_bl.0 Request processed in 250us (416us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787599410.037816:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:0.0:1787599410.038496:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874433543323008:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599410.038521:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599410.040653:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599410.040812:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522369536 00000100:00100000:3.0:1787599410.040822:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522369536 00010000:00010000:3.0:1787599410.040862:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074fb expref: 28 pid: 8189 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599410.040963:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:3.0:1787599410.040975:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:2358:x1874433522369536:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599410.040992:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599410.040999:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074fb expref: 28 pid: 8189 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.041011:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074fb expref: 28 pid: 8189 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.041045:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031200/0xa46cbc6741183446 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e074fb expref: 28 pid: 8189 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.041072:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:3.0:1787599410.041077:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.041087:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.041095:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.041509:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599410.041585:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:2358:x1874433522369536:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 613us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599410.041598:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 85 00010000:00010000:2.0:1787599410.042500:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042512:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599410.042670:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787599410.042676:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599410.042700:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042715:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042724:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc674118352d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042731:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc674118352d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042738:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc674118352d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042744:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030a00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599410.042761:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc674118352d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042768:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc674118352d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042791:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:2.0:1787599410.042794:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599410.042798:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc674118352d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042804:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030a00/0xa46cbc674118352d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042818:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042824:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183534 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042830:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042835:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599410.042838:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042843:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183534 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042851:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f6c70382000) 00010000:00010000:2.0:1787599410.042853:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599410.042862:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183534 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042868:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183534 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.042985:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030000/0xa46cbc6741183526 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0753a expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.043001:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0753a expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599410.043008:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:2.0:1787599410.043010:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599410.043012:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031800, rc 0) 00000100:00100000:2.0:1787599410.043331:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11628:x1874433522369152:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 11573us (13472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599410.043340:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 232 00010000:00010000:3.0:1787599410.149317:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787599410.270459:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1787599410.270471:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1787599410.270856:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000040:00080000:0.0:1787599410.717315:0:12547:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599410.717325:0:12547:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599410.717370:0:12547:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787599410.717375:0:12547:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787599410.977604:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787599410.977613:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599410.977645:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787599410.977651:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787599410.977951:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75dc8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543323136:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787599410.978054:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c758559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599410.983896:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75dc8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11665:1874433543323136:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787599410.989004:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599410.989472:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522369664 00000100:00100000:0.0:1787599410.989495:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522369664 00000100:00100000:0.0:1787599410.989561:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 233 00000100:00100000:0.0:1787599410.989573:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11640:x1874433522369664:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787599410.989608:0:8189:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787599410.990997:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11640:x1874433522369664:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 1418us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599410.991008:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 233 00000100:00100000:1.0:1787599410.996660:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599410.996849:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522369920 00000100:00100000:3.0:1787599410.996859:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522369920 00000100:00100000:3.0:1787599410.996969:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 234 00000100:00100000:3.0:1787599410.996981:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+26:11640:x1874433522369920:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599410.997001:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599410.997023:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183542 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07541 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.997128:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067200/0xa46cbc6741183549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.997215:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067200/0xa46cbc6741183549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.997227:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067200/0xa46cbc6741183549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599410.997348:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787599410.997478:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183542 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07541 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.997498:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067200/0xa46cbc6741183549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07541 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599410.997507:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:3.0:1787599410.997510:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599410.997515:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c76067200, rc 0) 00000100:00100000:3.0:1787599410.997578:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:11640:x1874433522369920:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 599us (929us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787599410.997585:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 234 00000100:00100000:1.0:1787599411.000443:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599411.000537:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522370048 00000100:00100000:0.0:1787599411.000547:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522370048 00000100:00100000:0.0:1787599411.000665:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1787599411.000677:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58453850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:2359:x1874433522370048:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599411.000702:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599411.000730:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067200/0xa46cbc6741183549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07541 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599411.000750:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599411.000764:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599411.000823:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58453850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:2359:x1874433522370048:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 149us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599411.000831:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00080000:3.0:1787599411.009266:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599411.009411:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599411.009491:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522370304 00000100:00100000:3.0:1787599411.009501:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522370304 00000100:00100000:3.0:1787599411.009557:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 235 00000100:00100000:3.0:1787599411.009567:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+27:11640:x1874433522370304:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787599411.009650:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183557 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599411.009669:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599411.009697:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599411.009904:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599411.009912:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183557 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599411.009918:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599411.009924:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599411.011332:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599411.011345:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183557 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599411.011362:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:3.0:1787599411.011364:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599411.011369:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183557 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599411.011375:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76066e00/0xa46cbc6741183557 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599411.011865:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:11640:x1874433522370304:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 2294us (2455us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787599411.011876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 235 00000040:00080000:2.0:1787599411.012218:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599411.012224:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787599411.015332:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000040:00080000:2.0:1787599411.015550:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787599411.015564:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787599411.015916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522370560 00000100:00100000:3.0:1787599411.015928:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522370560 00000100:00100000:3.0:1787599411.016021:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:3.0:1787599411.016040:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+28:11640:x1874433522370560:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787599411.016338:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:11640:x1874433522370560:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 298us (1015us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787599411.016346:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00010000:00010000:1.0:1787599411.169399:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599412.065905:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599412.065919:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599412.065960:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787599412.065967:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787599412.193675:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599412.257661:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543323264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599412.257778:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599412.257974:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543323264 00000100:00100000:3.0:1787599412.257986:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543323264 00000100:00100000:3.0:1787599412.258059:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787599412.258085:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543323264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599412.258153:0:12105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599412.258244:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543323264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599412.258252:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787599412.258282:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599412.258683:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543323264:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787599412.646864:0:12599:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787599412.646881:0:12599:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599412.646939:0:12599:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787599412.646947:0:12599:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787599412.842995:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599412.848222:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522370816 00000100:00100000:0.0:1787599412.848240:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522370816 00000100:00100000:0.0:1787599412.848333:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 236 00000100:00100000:0.0:1787599412.848345:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+29:11660:x1874433522370816:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599412.848374:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599412.848396:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc674118355e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07548 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599412.848821:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741183565 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599412.848838:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741183565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599412.848853:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741183565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599412.848864:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787599412.848999:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751fee00/0xa46cbc674118355e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07548 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599412.849019:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741183565 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07548 expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599412.849029:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:0.0:1787599412.849032:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787599412.849035:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ffa00, rc 0) 00000100:00100000:0.0:1787599412.849907:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:11660:x1874433522370816:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1559us (6919us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787599412.849918:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 236 00000100:00100000:3.0:1787599412.871775:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599412.871821:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599412.871853:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599412.871862:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522371200 00000100:00100000:1.0:1787599412.871875:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522371200 00000100:00100000:3.0:1787599412.871884:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599412.871895:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522370944 00000100:00100000:2.0:1787599412.871901:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522370944 00000100:00100000:2.0:1787599412.871954:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 303 00000100:00100000:2.0:1787599412.871965:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522370944:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599412.872051:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522370944:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599412.872058:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 303 00000100:00100000:2.0:1787599412.872104:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522371072 00000100:00100000:2.0:1787599412.872108:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522371072 00000100:00100000:2.0:1787599412.872141:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:2.0:1787599412.872148:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522371200:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599412.872200:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522371200:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 52us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599412.872207:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:2.0:1787599412.872221:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:2.0:1787599412.872228:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2357:x1874433522371072:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599412.872255:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2357:x1874433522371072:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599412.872262:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00080000:1.0:1787599412.873264:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599412.873271:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599412.873418:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522371328 00000100:00100000:0.0:1787599412.873433:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522371328 00000100:00100000:0.0:1787599412.873489:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 165 00000100:00100000:0.0:1787599412.873498:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522371328:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599412.873552:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522371328:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 55us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599412.873560:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 165 00000100:00080000:2.0:1787599412.874579:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599412.885746:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599412.885784:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522371456 00000100:00100000:3.0:1787599412.885794:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522371456 00000100:00100000:3.0:1787599412.885847:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 237 00000100:00100000:3.0:1787599412.885859:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:11660:x1874433522371456:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1787599412.885934:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067400/0xa46cbc6741183573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599412.885972:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067400/0xa46cbc6741183573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599412.885983:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067400/0xa46cbc6741183573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599412.886010:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067400/0xa46cbc6741183573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599412.886016:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067400/0xa46cbc6741183573 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599412.886024:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067400/0xa46cbc6741183573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599412.886030:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599412.886034:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067400/0xa46cbc6741183573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599412.886041:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067400/0xa46cbc6741183573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599412.886050:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:3.0:1787599412.886053:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599412.886057:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067400/0xa46cbc6741183573 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599412.886063:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c76067400/0xa46cbc6741183573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599412.886132:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+31:11660:x1874433522371456:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 275us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599412.886145:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 237 00000100:00100000:2.0:1787599413.046617:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599413.046763:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522371584 00000100:00100000:0.0:1787599413.046776:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522371584 00000100:00100000:0.0:1787599413.046849:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:0.0:1787599413.046861:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2358:x1874433522371584:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:0.0:1787599413.046881:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599413.046914:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc674118357a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0754f expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599413.046952:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c9a2f, atime: 0x6a8c9a2f, ctime: 0x6a8c9a2f, blocks: 0xb 00010000:00010000:0.0:1787599413.046973:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=370s v=(0 0) 00010000:00010000:0.0:1787599413.046978:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599413.046988:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc674118357a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0754f expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599413.047009:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc674118357a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0754f expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599413.047023:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fee00, rc 0) 00000100:00100000:0.0:1787599413.047349:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2358:x1874433522371584:12345-192.168.204.30@tcp:101:cat.0 Request processed in 489us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599413.047370:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 71 00000100:00100000:3.0:1787599413.055816:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599413.055967:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522371712 00000100:00100000:0.0:1787599413.055977:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522371712 00002000:00100000:0.0:1787599413.056145:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9f6c76165880 x1874433522371712/t0(0) o3->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:269/0 lens 488/0 e 0 to 0 dl 1787599424 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787599413.056187:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c76165880 with x1874433522371712 ext(0->4095) 00002000:00010000:0.0:1787599413.056193:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c76165880 00000100:00100000:0.0:1787599413.056228:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:0.0:1787599413.056240:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522371712:12345-192.168.204.30@tcp:3:cat.0 00000100:00100000:0.0:1787599413.056442:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+8:2359:x1874433522371712:12345-192.168.204.30@tcp:3:cat.0 Request processed in 203us (635us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787599413.056450:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00002000:00100000:0.0:1787599413.056458:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9f6c76165880 x1874433522371712/t0(0) o3->3d8318fd-1d0f-4438-bc2c-ebacb6a98551@192.168.204.30@tcp:269/0 lens 488/4536 e 0 to 0 dl 1787599424 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787599413.056467:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f6c76165880 with x1874433522371712 ext(0->4095) 00002000:00010000:0.0:1787599413.056470:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f6c76165880 00010000:00010000:1.0:1787599413.217417:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599414.242868:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599414.306353:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543323776:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.306422:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599414.306480:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787599414.306486:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543323392:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.306517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599414.306540:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543323904:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.306567:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599414.306595:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543323520:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.306617:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599414.306635:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543324032:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.306655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599414.306681:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599414.306687:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543323648:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.306727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599414.306761:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543323776 00000100:00100000:1.0:1787599414.306768:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543323776 00000100:00100000:1.0:1787599414.306815:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543324032 00000100:00100000:1.0:1787599414.306818:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543324032 00000100:00100000:1.0:1787599414.306844:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787599414.306853:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543323776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.306904:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1874433543323776:12345-0@lo:400:kworker.0 Request processed in 52us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599414.306912:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787599414.306931:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787599414.306937:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543324032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.306968:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543324032:12345-0@lo:400:kworker.0 Request processed in 32us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599414.306974:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787599414.306991:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543323392 00000100:00100000:1.0:1787599414.306994:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543323392 00000100:00100000:1.0:1787599414.307019:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787599414.307026:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543323392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.307055:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543323392:12345-0@lo:400:kworker.0 Request processed in 31us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599414.307062:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787599414.307088:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543323904 00000100:00100000:1.0:1787599414.307092:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543323904 00000100:00100000:1.0:1787599414.307117:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543323520 00000100:00100000:1.0:1787599414.307120:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543323520 00000100:00100000:1.0:1787599414.307139:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543323648 00000100:00100000:1.0:1787599414.307142:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543323648 00000100:00100000:1.0:1787599414.307191:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787599414.307199:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543323904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.307230:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543323904:12345-0@lo:400:kworker.0 Request processed in 33us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599414.307236:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787599414.307246:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787599414.307251:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543323520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.307278:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543323520:12345-0@lo:400:kworker.0 Request processed in 26us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599414.307284:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787599414.307295:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787599414.307301:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543323648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.307325:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543323648:12345-0@lo:400:kworker.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599414.307331:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1787599414.307357:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599414.307361:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599414.307363:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599414.307403:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543323648:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.307415:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543323520:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.307424:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787599414.307428:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c6f27c000, transno 4294967307 00000004:00080000:1.0:1787599414.307439:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787599414.307456:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c750fbb80, transno 4294967310 00000100:00100000:1.0:1787599414.307470:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543324032:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.307768:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543323392:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.307780:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543323904:0@lo:400:kworker.0 00000100:00100000:1.0:1787599414.307790:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543323776:0@lo:400:kworker.0 00000100:00100000:3.0:1787599414.308266:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599414.310877:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c6f27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543324160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599414.310957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599414.316014:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543324160 00000100:00100000:1.0:1787599414.316030:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543324160 00000100:00100000:1.0:1787599414.316093:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787599414.316104:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543324160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599414.316148:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599414.316267:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543324160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (5309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599414.316273:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787599414.316375:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c6f27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543324160:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787599414.886645:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787599414.886794:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787599414.886856:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1787599414.886872:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:0.0:1787599414.886962:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f6c4fe98a80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787599414.886968:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c75b63100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c4fe98000 00000020:00080000:0.0:1787599414.886971:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f6c75b63d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f6c76163000 00000020:00080000:2.0:1787599414.887095:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787599414.887320:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787599415.268652:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787599415.401236:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1787599415.401267:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1787599415.401275:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:0.0:1787599416.291128:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599417.316645:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599417.378607:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543324288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599417.378721:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599417.378841:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543324288 00000100:00100000:1.0:1787599417.378853:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543324288 00000100:00100000:1.0:1787599417.378927:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787599417.378940:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543324288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599417.378991:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599417.379050:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543324288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599417.379059:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787599417.379086:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599417.379138:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787599417.379145:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c76166a00, transno 4294967322 00000004:00080000:1.0:1787599417.379185:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787599417.379239:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543324288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599417.994093:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599417.994187:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599417.994216:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599417.994237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599417.994258:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599417.994798:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522371840 00000100:00100000:1.0:1787599417.994813:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522371840 00000100:00100000:1.0:1787599417.995030:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 305 00000100:00100000:1.0:1787599417.995044:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522371840:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599417.995147:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2357:x1874433522371840:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 106us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599417.995179:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 305 00000100:00100000:1.0:1787599417.995222:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522372096 00000100:00100000:1.0:1787599417.995226:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522372096 00000100:00100000:1.0:1787599417.995267:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522372224 00000100:00100000:1.0:1787599417.995271:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522372224 00000100:00100000:1.0:1787599417.995293:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:1.0:1787599417.995299:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2357:x1874433522372096:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599417.995334:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2357:x1874433522372096:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 35us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599417.995341:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:1.0:1787599417.995354:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:1.0:1787599417.995361:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522372224:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599417.995385:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2357:x1874433522372224:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599417.995390:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:1.0:1787599417.995430:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522372352 00000100:00100000:1.0:1787599417.995433:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522372352 00000100:00100000:1.0:1787599417.995461:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522371968 00000100:00100000:1.0:1787599417.995464:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522371968 00000100:00100000:1.0:1787599417.995484:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 169 00000100:00100000:1.0:1787599417.995491:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522372352:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599417.995520:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2357:x1874433522372352:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 31us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599417.995527:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 169 00000100:00100000:1.0:1787599417.995538:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 170 00000100:00100000:1.0:1787599417.995544:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f27c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:2357:x1874433522371968:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599417.995573:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f27c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:2357:x1874433522371968:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599417.995579:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 170 00000100:00080000:1.0:1787599417.999554:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599417.999570:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599417.999574:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599418.034496:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599418.034606:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522372480 00000100:00100000:1.0:1787599418.034631:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522372480 00000100:00100000:1.0:1787599418.034714:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 238 00000100:00100000:1.0:1787599418.034727:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:11305:x1874433522372480:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787599418.034877:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:11305:x1874433522372480:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 Request processed in 153us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599418.034886:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 238 00000100:00100000:3.0:1787599418.037933:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599418.038694:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522372736 00000100:00100000:1.0:1787599418.038708:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522372736 00000100:00100000:1.0:1787599418.038785:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 65 00000100:00100000:1.0:1787599418.038811:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:11305:x1874433522372736:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787599418.040662:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:11305:x1874433522372736:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 1845us (2735us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787599418.040673:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 65 00010000:00010000:0.0:1787599418.338586:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599418.380795:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599418.381100:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522372864 00000100:00100000:1.0:1787599418.381111:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522372864 00000100:00100000:1.0:1787599418.381286:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 239 00000100:00100000:1.0:1787599418.381298:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:12112:x1874433522372864:12345-192.168.204.30@tcp:101:lsof.0 00010000:00010000:1.0:1787599418.381340:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599418.381362:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183581 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07556 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599418.381428:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc6741183588 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599418.381443:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc6741183588 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599418.381455:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc6741183588 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599418.381784:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787599418.381789:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599418.381870:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc6741183588 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599418.381897:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddf200/0xa46cbc6741183581 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07556 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599418.381929:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc6741183588 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07556 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599418.381938:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:1.0:1787599418.381942:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599418.381946:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75dde400, rc 0) 00000100:00100000:1.0:1787599418.382466:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:12112:x1874433522372864:12345-192.168.204.30@tcp:101:lsof.0 Request processed in 1167us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599418.382476:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 239 00010000:00010000:1.0:1787599419.361395:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599419.425893:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543324800:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.425963:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599419.426023:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787599419.426030:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543324416:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426061:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599419.426084:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543324928:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426107:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599419.426133:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543324672:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599419.426199:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787599419.426204:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543324544:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599419.426241:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543325056:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599419.426305:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543324416 00000100:00100000:1.0:1787599419.426313:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543324416 00000100:00100000:1.0:1787599419.426358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787599419.426368:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543324416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426419:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3301:x1874433543324416:12345-0@lo:400:kworker.0 Request processed in 52us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599419.426426:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787599419.426458:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543324800 00000100:00100000:1.0:1787599419.426462:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543324800 00000100:00100000:1.0:1787599419.426495:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543325056 00000100:00100000:1.0:1787599419.426499:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543325056 00000100:00100000:1.0:1787599419.426518:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787599419.426525:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543324800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426565:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543324800:12345-0@lo:400:kworker.0 Request processed in 41us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599419.426571:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787599419.426582:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787599419.426587:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543325056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426626:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543325056:12345-0@lo:400:kworker.0 Request processed in 39us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599419.426632:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787599419.426645:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599419.426648:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599419.426661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543324928 00000100:00100000:1.0:1787599419.426664:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543324928 00000100:00100000:1.0:1787599419.426686:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543324672 00000100:00100000:1.0:1787599419.426688:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543324672 00000100:00100000:1.0:1787599419.426698:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787599419.426703:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543324928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426734:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543324928:12345-0@lo:400:kworker.0 Request processed in 31us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599419.426740:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787599419.426749:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543324544 00000100:00100000:1.0:1787599419.426751:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543324544 00000100:00100000:1.0:1787599419.426764:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787599419.426769:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543324672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426792:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874433543324672:12345-0@lo:400:kworker.0 Request processed in 23us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599419.426797:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787599419.426806:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787599419.426812:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543324544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426833:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543324544:12345-0@lo:400:kworker.0 Request processed in 22us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599419.426838:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1787599419.426850:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599419.426876:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543324544:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426886:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543325056:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426893:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874433543324672:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426939:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543324416:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426948:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543324928:0@lo:400:kworker.0 00000100:00100000:1.0:1787599419.426956:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543324800:0@lo:400:kworker.0 00000100:00100000:0.0:1787599419.428679:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599419.428700:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543325184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599419.428761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599419.428850:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543325184 00000100:00100000:2.0:1787599419.428858:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543325184 00000100:00100000:2.0:1787599419.428921:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787599419.428931:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543325184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599419.428967:0:12105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599419.429020:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543325184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599419.429028:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787599419.429071:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543325184:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787599420.043127:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787599420.043150:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787599420.043239:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787599420.043251:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787599420.385438:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599421.411065:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599422.305440:0:11665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787599422.305455:0:11665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599422.306462:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787599422.306476:0:11665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787599422.435902:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599422.498196:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599422.498221:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543325312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599422.498298:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599422.498378:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543325312 00000100:00100000:3.0:1787599422.498386:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543325312 00000100:00100000:3.0:1787599422.498463:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787599422.498475:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543325312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599422.498513:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599422.498569:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76195f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543325312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599422.498578:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787599422.498629:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76194000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543325312:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787599422.500699:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1787599422.680878:0:12801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:23:39 (1787599419) 00000100:00100000:3.0:1787599423.112537:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599423.112580:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599423.112612:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599423.112643:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599423.112671:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599423.112706:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522373504 00000100:00100000:3.0:1787599423.112727:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522373504 00000100:00100000:3.0:1787599423.112778:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522373120 00000100:00100000:3.0:1787599423.112781:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522373120 00000100:00100000:3.0:1787599423.112815:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:3.0:1787599423.112825:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2356:x1874433522373504:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599423.112897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2356:x1874433522373504:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 74us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599423.112905:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:3.0:1787599423.112922:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:3.0:1787599423.112929:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:2356:x1874433522373120:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599423.112949:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522373248 00000100:00100000:1.0:1787599423.112955:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522373248 00000100:00100000:3.0:1787599423.112960:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:2356:x1874433522373120:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 30us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599423.112968:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 175 00000100:00100000:3.0:1787599423.112988:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522373376 00000100:00100000:3.0:1787599423.112993:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522373376 00000100:00100000:1.0:1787599423.113010:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00080000:2.0:1787599423.113082:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599423.113087:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599423.113089:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599423.113347:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2356:x1874433522373248:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599423.113390:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2356:x1874433522373248:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 372us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599423.115457:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522372992 00000100:00100000:0.0:1787599423.115470:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522372992 00000100:00100000:0.0:1787599423.115545:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 307 00000100:00100000:0.0:1787599423.115555:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522372992:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599423.115633:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2356:x1874433522372992:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 80us (3117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599423.115641:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 307 00000100:00100000:1.0:1787599423.116240:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00100000:3.0:1787599423.116264:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 93 00000100:00100000:3.0:1787599423.116277:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2356:x1874433522373376:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599423.116814:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2356:x1874433522373376:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 539us (4140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599423.116823:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 93 00010000:00010000:1.0:1787599423.458916:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599424.485149:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599424.548873:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599424.548895:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c759b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543325440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599424.548966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599424.549049:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543325440 00000100:00100000:0.0:1787599424.549057:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543325440 00000100:00100000:0.0:1787599424.549116:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787599424.549125:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543325440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599424.549195:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599424.549254:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543325440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599424.549260:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787599424.549281:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599424.549321:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c759b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543325440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599424.551593:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c759b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543325696:0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.551668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599424.551718:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787599424.551723:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543325568:0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.551754:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599424.551787:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543326080:0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.551810:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599424.551840:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543325696 00000100:00100000:0.0:1787599424.551848:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543325696 00000100:00100000:0.0:1787599424.551894:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543326080 00000100:00100000:0.0:1787599424.551897:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543326080 00000100:00100000:0.0:1787599424.551927:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787599424.551936:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543325696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.551990:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543325696:12345-0@lo:400:kworker.0 Request processed in 55us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599424.551997:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787599424.552014:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787599424.552020:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543326080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.552044:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543326080:12345-0@lo:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599424.552049:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787599424.552084:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543325568 00000100:00100000:0.0:1787599424.552088:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543325568 00000100:00100000:0.0:1787599424.552109:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787599424.552116:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543325568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.552147:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543325568:12345-0@lo:400:kworker.0 Request processed in 31us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599424.552192:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:0.0:1787599424.552231:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599424.552244:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543325824:0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.552274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599424.552296:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599424.552302:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543325952:0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.552328:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599424.552872:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543325952 00000100:00100000:0.0:1787599424.552877:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543325952 00000100:00100000:0.0:1787599424.552973:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787599424.552984:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543325952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.553028:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543325952:12345-0@lo:400:kworker.0 Request processed in 47us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599424.553036:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787599424.553060:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543325824 00000100:00100000:0.0:1787599424.553064:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543325824 00000100:00080000:2.0:1787599424.557875:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599424.558119:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787599424.558134:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543325824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.558251:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543325824:12345-0@lo:400:kworker.0 Request processed in 122us (5975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599424.558259:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787599424.558332:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543325568:0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.558860:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543326080:0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.558876:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c759b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543325696:0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.558924:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543325952:0@lo:400:kworker.0 00000100:00100000:0.0:1787599424.558935:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543325824:0@lo:400:kworker.0 00000100:00080000:2.0:1787599424.559503:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787599425.508227:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599426.529416:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599427.553410:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599427.617421:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543326208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599427.617513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599427.617729:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543326208 00000100:00100000:3.0:1787599427.617738:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543326208 00000100:00100000:3.0:1787599427.617826:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787599427.617839:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c759b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543326208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599427.617877:0:12105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599427.617930:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c759b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543326208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599427.617954:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787599427.618184:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543326208:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787599427.618299:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599428.008509:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599428.008611:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522373760 00000100:00100000:1.0:1787599428.008623:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522373760 00000100:00100000:1.0:1787599428.008698:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:1.0:1787599428.008718:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+18:12335:x1874433522373760:12345-192.168.204.30@tcp:35:umount.0 00000100:00080000:2.0:1787599428.009254:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599428.011131:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:12335:x1874433522373760:12345-192.168.204.30@tcp:35:umount.0 Request processed in 2404us (2620us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787599428.011144:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 66 00000100:00100000:2.0:1787599428.024514:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599428.024672:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522374016 00000100:00100000:3.0:1787599428.024683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522374016 00000100:00100000:3.0:1787599428.024760:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:3.0:1787599428.024773:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+19:12335:x1874433522374016:12345-192.168.204.30@tcp:35:umount.0 00000100:00100000:3.0:1787599428.025145:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:12335:x1874433522374016:12345-192.168.204.30@tcp:35:umount.0 Request processed in 373us (640us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787599428.025153:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 67 00000100:00100000:2.0:1787599428.028954:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599428.029080:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522374272 00000100:00100000:3.0:1787599428.029090:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522374272 00000100:00100000:3.0:1787599428.029183:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:3.0:1787599428.029195:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c50c7b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+20:12335:x1874433522374272:12345-192.168.204.30@tcp:35:umount.0 00000100:00100000:3.0:1787599428.030255:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c50c7b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:12335:x1874433522374272:12345-192.168.204.30@tcp:35:umount.0 Request processed in 1057us (1305us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787599428.030266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 68 00000100:00100000:2.0:1787599428.046246:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599428.050356:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522374528 00000100:00100000:1.0:1787599428.050489:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522374528 00000100:00100000:1.0:1787599428.050574:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:1.0:1787599428.050585:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+21:12335:x1874433522374528:12345-192.168.204.30@tcp:35:umount.0 00000100:00100000:1.0:1787599428.050973:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:12335:x1874433522374528:12345-192.168.204.30@tcp:35:umount.0 Request processed in 388us (4736us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787599428.050982:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 69 00000100:00100000:2.0:1787599428.058274:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599428.058310:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599428.058339:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599428.058378:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599428.058516:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522374656 00000100:00100000:0.0:1787599428.058528:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522374656 00000100:00100000:0.0:1787599428.058594:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 72 00000100:00100000:0.0:1787599428.058605:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+5:2355:x1874433522374656:12345-192.168.204.30@tcp:9:umount.0 00000020:00000080:0.0:1787599428.058634:0:11786:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc67411828d8 00000100:00080000:0.0:1787599428.058643:0:11786:0:(import.c:65:import_set_state_nolock()) ffff9f6c451f9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787599428.058685:0:11786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787599428.058977:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+2:2355:x1874433522374656:12345-192.168.204.30@tcp:9:umount.0 Request processed in 372us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599428.058985:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 72 00010000:00010000:0.0:1787599428.059012:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599428.059020:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599428.059845:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522374784 00000100:00100000:3.0:1787599428.059855:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522374784 00000100:00100000:3.0:1787599428.059906:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522375040 00000100:00100000:3.0:1787599428.059909:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522375040 00000100:00100000:3.0:1787599428.059924:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522374912 00000100:00100000:3.0:1787599428.059927:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522374912 00000100:00100000:3.0:1787599428.059943:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:3.0:1787599428.059950:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+15:2358:x1874433522374784:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599428.059962:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599428.059986:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75619a00/0xa46cbc674118259e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070e1 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599428.060023:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599428.060061:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+14:2358:x1874433522374784:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 111us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.060068:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:3.0:1787599428.060085:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:3.0:1787599428.060091:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+13:2358:x1874433522375040:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599428.060098:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599428.060108:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d9600/0xa46cbc6741182814 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071ac expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599428.060118:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599428.060133:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:2358:x1874433522375040:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 43us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.060139:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:3.0:1787599428.060150:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:3.0:1787599428.060195:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c70138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:2358:x1874433522374912:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599428.060453:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599428.060540:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751ffc00/0xa46cbc6741182566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070a9 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599428.060551:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599428.061335:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c70138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2358:x1874433522374912:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 1173us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599428.061345:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1787599428.070032:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599428.070141:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522375424 00000100:00100000:2.0:1787599428.070151:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522375424 00000100:00100000:2.0:1787599428.070257:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 73 00000100:00100000:2.0:1787599428.070269:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2355:x1874433522375424:12345-192.168.204.30@tcp:9:umount.0 00000020:00000080:2.0:1787599428.070311:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182b39 00000020:00010000:2.0:1787599428.070320:0:6677:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f6c75f2b800: total 0 00000100:00080000:2.0:1787599428.070325:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9f6b4664b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599428.070509:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:0.0:1787599428.071034:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1787599428.071329:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f6c75f2b800: total 0 00010000:00010000:3.0:1787599428.071477:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f6c75f2b800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787599428.071544:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000496d45dc/0xa46cbc674118357a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0754f expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599428.071582:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b0dc47f/0xa46cbc6741182edc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07381 expref: 5 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599428.071983:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+4:2355:x1874433522375424:12345-192.168.204.30@tcp:9:umount.0 Request processed in 1714us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599428.071994:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 73 00010000:00010000:3.0:1787599428.072070:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f6c75f2b800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787599428.072086:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599428.072088:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599428.072090:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599428.095715:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599428.096020:0:8189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522376448 00000100:00100000:2.0:1787599428.096030:0:8189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522376448 00000100:00100000:2.0:1787599428.096090:0:8189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 240 00000100:00100000:2.0:1787599428.096101:0:8189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+22:2355:x1874433522376448:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:2.0:1787599428.096133:0:8189:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182574 00000020:00010000:2.0:1787599428.096150:0:8189:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f6b4432e800: total 0 00000100:00080000:2.0:1787599428.096205:0:8189:0:(import.c:65:import_set_state_nolock()) ffff9f6b44329800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599428.096230:0:8189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1787599428.096680:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f6b4432e800: total 0 00010000:00010000:1.0:1787599428.096685:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599428.096732:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f6b4432e800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787599428.096777:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f6c50836d00) 00010000:00010000:1.0:1787599428.096781:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599428.096790:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8e00/0xa46cbc674118283e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071ba expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.096823:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:1.0:1787599428.096826:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787599428.096830:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741182ec7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0737a expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.096843:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:1.0:1787599428.096845:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599428.096849:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183239 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07476 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.096861:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:1.0:1787599428.096863:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787599428.096866:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ffa00/0xa46cbc6741183565 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07548 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.096896:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f6c70860c00) 00010000:00010000:1.0:1787599428.096899:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787599428.096902:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24de00/0xa46cbc6741182f5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e073a4 expref: 17 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.096917:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:1.0:1787599428.096920:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599428.096922:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75618600/0xa46cbc6741182dbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07334 expref: 16 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.096933:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599428.096935:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787599428.096938:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc67411828ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071d6 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.096947:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:1.0:1787599428.096949:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599428.096952:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75ddee00/0xa46cbc674118345b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07502 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.096963:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f6c70860b00) 00010000:00010000:1.0:1787599428.096965:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787599428.096968:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8600/0xa46cbc6741182b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e072a8 expref: 13 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.096980:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f6c43a07d00) 00010000:00010000:1.0:1787599428.096983:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599428.096994:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc674118353b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0753a expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.097010:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:1.0:1787599428.097012:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599428.097016:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c751ff800/0xa46cbc6741182f3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0739d expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.097025:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c50836800) 00010000:00010000:1.0:1787599428.097027:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599428.097030:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c582d8000/0xa46cbc674118285a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071c1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.097042:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:1.0:1787599428.097044:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599428.097047:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75619c00/0xa46cbc6741182e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0736c expref: 9 pid: 8189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599428.097059:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f6b4432e800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787599428.097073:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599428.097075:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599428.097077:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599428.097465:0:8189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d8318fd-1d0f-4438-bc2c-ebacb6a98551+7:2355:x1874433522376448:12345-192.168.204.30@tcp:39:umount.0 Request processed in 1362us (1757us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787599428.097475:0:8189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 240 00000100:00100000:0.0:1787599428.227471:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599428.227527:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599428.227682:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522376576 00000100:00100000:1.0:1787599428.227693:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522376576 00000100:00100000:1.0:1787599428.227751:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 309 00000100:00100000:1.0:1787599428.227761:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2359:x1874433522376576:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599428.227841:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2359:x1874433522376576:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 82us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599428.227864:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 309 00000100:00100000:2.0:1787599428.228571:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522376704 00000100:00100000:2.0:1787599428.228586:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522376704 00000100:00100000:2.0:1787599428.228643:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 179 00000100:00100000:2.0:1787599428.228651:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2359:x1874433522376704:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599428.228713:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2359:x1874433522376704:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 63us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599428.228720:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 179 00000100:00080000:0.0:1787599428.228948:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787599428.577967:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599429.601560:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599429.666054:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543326336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599429.666096:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543326464:0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.666141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599429.666147:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599429.666226:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543326848:0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.666254:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599429.666290:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543326336 00000100:00100000:0.0:1787599429.666297:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543326336 00000100:00100000:0.0:1787599429.666656:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599429.666666:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c750fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543326336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599429.666702:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599429.666759:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c750fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543326336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599429.666766:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599429.666788:0:11786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543326848 00000100:00100000:0.0:1787599429.666792:0:11786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543326848 00000100:00100000:0.0:1787599429.666819:0:11786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787599429.666826:0:11786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543326848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.666857:0:11786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543326848:12345-0@lo:400:kworker.0 Request processed in 32us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599429.666863:0:11786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1787599429.666877:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599429.666881:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599429.666908:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543326848:0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.666922:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543326336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599429.666972:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543326592:0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.666998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599429.667017:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599429.667035:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543326720:0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.667055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599429.667076:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543326592 00000100:00100000:0.0:1787599429.667080:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543326592 00000100:00100000:0.0:1787599429.667100:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543326720 00000100:00100000:0.0:1787599429.667102:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543326720 00000100:00100000:0.0:1787599429.667121:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787599429.667126:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543326592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.667186:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543326592:12345-0@lo:400:kworker.0 Request processed in 59us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599429.667192:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787599429.667203:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787599429.667209:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c483b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543326720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.667232:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c483b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543326720:12345-0@lo:400:kworker.0 Request processed in 24us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599429.667237:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:0.0:1787599429.667248:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599429.667264:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543326720:0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.667272:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543326592:0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.667320:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543326464 00000100:00100000:0.0:1787599429.667324:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543326464 00000100:00100000:0.0:1787599429.667347:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787599429.667353:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543326464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599429.669898:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599429.669918:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543326976:0@lo:400:kworker.0 00000100:00100000:2.0:1787599429.669983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599429.670245:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543326976 00000100:00100000:1.0:1787599429.670253:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543326976 00000100:00100000:1.0:1787599429.670322:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787599429.670332:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543326976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599429.670411:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543326976:12345-0@lo:400:kworker.0 Request processed in 80us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599429.670418:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:2.0:1787599429.672232:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599429.672296:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543326976:0@lo:400:kworker.0 00000100:00100000:0.0:1787599429.673986:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3302:x1874433543326464:12345-0@lo:400:kworker.0 Request processed in 6623us (7830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599429.673998:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787599429.677033:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3302:1874433543326464:0@lo:400:kworker.0 00000100:00100000:0.0:1787599430.017828:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599430.017881:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599430.017919:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599430.018027:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522376832 00000100:00100000:3.0:1787599430.018038:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522376832 00000100:00100000:3.0:1787599430.018110:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522377088 00000100:00100000:3.0:1787599430.018114:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522377088 00000100:00100000:3.0:1787599430.018129:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522376960 00000100:00100000:3.0:1787599430.018131:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522376960 00000100:00100000:3.0:1787599430.018148:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:3.0:1787599430.018183:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+12:2359:x1874433522376832:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599430.018200:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599430.018220:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75618c00/0xa46cbc6741182646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070f6 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599430.018239:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599430.018309:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+11:2359:x1874433522376832:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 152us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599430.018318:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:3.0:1787599430.018339:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:3.0:1787599430.018345:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76093b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+10:2359:x1874433522377088:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599430.018354:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599430.018378:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24d400/0xa46cbc674118280d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e071a5 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599430.018587:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599430.018608:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76093b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+9:2359:x1874433522377088:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 262us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599430.018614:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:3.0:1787599430.018627:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:3.0:1787599430.018634:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+8:2359:x1874433522376960:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599430.018641:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599430.018651:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75619800/0xa46cbc674118264d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07120 expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599430.018660:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599430.018675:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+7:2359:x1874433522376960:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 42us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599430.018681:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1787599430.034973:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599430.035214:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522377344 00000100:00100000:2.0:1787599430.035225:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522377344 00000100:00100000:2.0:1787599430.035370:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 241 00000100:00100000:2.0:1787599430.035382:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+6:2355:x1874433522377344:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:2.0:1787599430.035435:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc674118265b 00000020:00010000:2.0:1787599430.035443:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f6c81f36800: total 0 00000100:00080000:2.0:1787599430.035448:0:5832:0:(import.c:65:import_set_state_nolock()) ffff9f6c81f33800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599430.035476:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787599430.035701:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d1eea31-9ea5-425c-a3e4-31fb355e375a+5:2355:x1874433522377344:12345-192.168.204.30@tcp:39:umount.0 Request processed in 320us (738us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787599430.035709:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 241 00000020:00010000:1.0:1787599430.039335:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f6c81f36800: total 0 00010000:00010000:1.0:1787599430.039432:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f6c81f36800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787599430.039471:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c43a07500) 00010000:00010000:1.0:1787599430.039475:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599430.039487:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75dde400/0xa46cbc6741183588 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07556 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599430.039514:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f6c81f36800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787599430.039526:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599430.039528:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599430.039530:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599430.042784:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599430.062949:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599430.063527:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522377600 00000100:00100000:0.0:1787599430.063539:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522377600 00000100:00100000:0.0:1787599430.063604:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 311 00000100:00100000:0.0:1787599430.063615:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c469ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+7:2355:x1874433522377600:12345-192.168.204.30@tcp:251:umount.0 00000020:00000080:0.0:1787599430.063663:0:5824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182551 00000020:00010000:0.0:1787599430.063671:0:5824:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f6c7662b000: total 0 00000100:00080000:0.0:1787599430.063675:0:5824:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662c000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787599430.063740:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c469ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ebe127c-c30c-4dc6-9c9b-887e7cd919f1+3:2355:x1874433522377600:12345-192.168.204.30@tcp:251:umount.0 Request processed in 126us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599430.063749:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 311 00000020:00010000:1.0:1787599430.063872:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f6c7662b000: total 0 00010000:00010000:1.0:1787599430.063877:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599430.063924:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f6c7662b000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787599430.063959:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75618400/0xa46cbc67411825a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e070e8 expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599430.063975:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f6c7662b000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787599430.064001:0:5819:0:(genops.c:885:class_export_put()) final put ffff9f6c7662b000/1ebe127c-c30c-4dc6-9c9b-887e7cd919f1 00010000:00010000:1.0:1787599430.064018:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599430.064020:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599430.064021:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787599430.064727:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c7662b000/1ebe127c-c30c-4dc6-9c9b-887e7cd919f1 for MGS 00000020:00000080:0.0:1787599430.064773:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c7662c000 for MGS 00000001:00080000:3.0:1787599430.264333:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1787599430.264354:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9d1eea31-9ea5-425c-a3e4-31fb355e375a 00000001:00080000:3.0:1787599430.264361:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787599430.264378:0:5853:0:(genops.c:885:class_export_put()) final put ffff9f6c81f36800/9d1eea31-9ea5-425c-a3e4-31fb355e375a 00000001:00100000:3.0:1787599430.264405:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000001:00080000:3.0:1787599430.264410:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787599430.264418:0:5853:0:(genops.c:885:class_export_put()) final put ffff9f6b4432e800/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:3.0:1787599430.264433:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c81f36800/9d1eea31-9ea5-425c-a3e4-31fb355e375a for lustre-MDT0000 00000020:00000080:3.0:1787599430.264488:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b4432e800/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 for lustre-MDT0000 00000020:00000080:3.0:1787599430.264518:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c81f33800 for lustre-MDT0000 00000020:00000080:3.0:1787599430.264523:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6b44329800 for lustre-MDT0000 00010000:00010000:1.0:1787599430.626500:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787599430.740976:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:0.0:1787599430.740987:0:6704:0:(genops.c:885:class_export_put()) final put ffff9f6c75f2b800/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:1.0:1787599430.741057:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c75f2b800/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 for lustre-OST0000 00000020:00000080:1.0:1787599430.741109:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6b4664b800 for lustre-OST0000 00000001:00100000:1.0:1787599430.776122:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:1.0:1787599430.776134:0:7625:0:(genops.c:885:class_export_put()) final put ffff9f6c451ff000/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 00000020:00000080:2.0:1787599430.776806:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c451ff000/3d8318fd-1d0f-4438-bc2c-ebacb6a98551 for lustre-OST0001 00000020:00000080:0.0:1787599430.777055:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c451f9800 for lustre-OST0001 00010000:00010000:3.0:1787599431.649507:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787599431.727625:0:13001:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787599431.738924:0:13001:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787599431.738971:0:13001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.738986:0:13001:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.738994:0:13001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.739014:0:13001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.739037:0:13001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787599431.739042:0:13001:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787599431.739062:0:13001:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787599431.739066:0:13001:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787599431.739072:0:13001:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787599431.739095:0:13001:0:(import.c:65:import_set_state_nolock()) ffff9f6c4fa07800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787599431.739351:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787599431.740489:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874433543327104:0@lo:39:umount.0 00000100:00100000:3.0:1787599431.740573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599431.741515:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543327104 00000100:00100000:0.0:1787599431.741526:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543327104 00000100:00100000:0.0:1787599431.741594:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787599431.741605:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874433543327104:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787599431.741635:0:5831:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc674118236e 00000100:00080000:0.0:1787599431.741645:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9f6c50234000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787599431.741734:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3298:x1874433543327104:12345-0@lo:39:umount.0 Request processed in 130us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599431.741742:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787599431.741754:0:5831:0:(genops.c:885:class_export_put()) final put ffff9f6c50234800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787599431.741787:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c50234800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787599431.741849:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c50234000 for lustre-MDT0000 00010000:00010000:2.0:1787599431.742009:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599431.742040:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9000 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:2.0:1787599431.742045:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599431.742055:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599431.742062:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599431.742068:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787599431.742071:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787599431.742074:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787599431.742106:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599431.742113:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599431.742138:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599431.742145:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9000/0xa46cbc67411825e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411825eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599431.742174:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599431.742177:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599431.742178:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599431.742307:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543327232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599431.742348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599431.742874:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787599431.742926:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c4fa07800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787599431.742948:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874433543327104:0@lo:39:umount.0 00000100:00080000:0.0:1787599431.746097:0:13001:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787599431.746104:0:13001:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787599431.746110:0:13001:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787599431.746979:0:13001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.746994:0:13001:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747001:0:13001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747008:0:13001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747033:0:13001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599431.747040:0:13001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747047:0:13001:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747054:0:13001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747061:0:13001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747082:0:13001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787599431.747089:0:13001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747096:0:13001:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747111:0:13001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747117:0:13001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747125:0:13001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787599431.747130:0:13001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747137:0:13001:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747143:0:13001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747149:0:13001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599431.747175:0:13001:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787599431.747178:0:13001:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787599431.747201:0:13001:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787599431.747204:0:13001:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787599431.747207:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599431.747212:0:13001:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787599431.747219:0:13001:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f6c50236000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787599431.747224:0:13001:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f6b44a7b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787599431.747229:0:13001:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9f6c76714d28) has exports, disconnecting them 00000020:00080000:0.0:1787599431.747239:0:13001:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f6c50236000), last request at 1787599429 00000020:00000080:0.0:1787599431.747246:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc67411824d3 00000100:00080000:0.0:1787599431.747261:0:13001:0:(import.c:65:import_set_state_nolock()) ffff9f6c4fdcb800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787599431.747303:0:13001:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f6c50236000): rc 0 00000020:00000080:0.0:1787599431.747305:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c50236000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787599431.747316:0:13001:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f6b44a7b800), last request at 1787599429 00000020:00000080:0.0:1787599431.747319:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182408 00000100:00080000:0.0:1787599431.747325:0:13001:0:(import.c:65:import_set_state_nolock()) ffff9f6b44a7b000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787599431.747335:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c50236000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787599431.747387:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c4fdcb800 for lustre-MDT0000 00000020:00080000:0.0:1787599431.747404:0:13001:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f6b44a7b800): rc 0 00000020:00000080:0.0:1787599431.747407:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6b44a7b800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787599431.747416:0:13001:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc2c382c53ae0 00000020:00000080:0.0:1787599431.747427:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b44a7b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787599431.747459:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6b44a7b000 for lustre-MDT0000 00000100:00080000:0.0:1787599431.747481:0:13001:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787599431.747484:0:13001:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787599431.747495:0:13001:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787599431.747551:0:13001:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787599431.747571:0:13001:0:(import.c:65:import_set_state_nolock()) ffff9f6c763f7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787599431.747587:0:13001:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787599431.747589:0:13001:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787599431.747598:0:13001:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787599431.747662:0:13001:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787599431.747671:0:13001:0:(import.c:65:import_set_state_nolock()) ffff9f6b4664e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787599431.747699:0:13001:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f6c76714d28) has no exports 00010000:00010000:3.0:1787599431.748432:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787599431.748442:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748451:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618000 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599431.748456:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748466:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599431.748474:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599431.748496:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787599431.748498:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787599431.748501:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787599431.748534:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748540:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599431.748563:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748570:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75618000/0xa46cbc67411825f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411825f9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748583:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787599431.748586:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748592:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031400 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599431.748595:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748601:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599431.748607:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599431.748612:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787599431.748615:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787599431.748617:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787599431.748635:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748641:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599431.748656:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748663:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c40031400/0xa46cbc674118250b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc6741182512 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748676:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599431.748679:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748684:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24ce00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599431.748687:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748694:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599431.748699:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599431.748704:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787599431.748706:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787599431.748708:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787599431.748718:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748724:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599431.748729:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748741:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ce00/0xa46cbc67411827ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc6741182806 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748751:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599431.748753:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748759:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c820f8000 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599431.748761:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748768:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599431.748774:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599431.748780:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787599431.748782:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787599431.748784:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787599431.748796:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748802:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599431.748807:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748813:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c820f8000/0xa46cbc67411822bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411822c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.748831:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599431.748833:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599431.748835:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599431.748856:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543327360:0@lo:9:umount.0 00000100:00100000:3.0:1787599431.748935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599431.748969:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543327488:0@lo:9:umount.0 00000100:00100000:3.0:1787599431.748988:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599431.749021:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543327616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599431.749046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599431.749211:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599431.749971:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599431.749981:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543328000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599431.750011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599431.750096:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543327232 00000100:00100000:2.0:1787599431.750105:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543327232 00000100:00100000:2.0:1787599431.750167:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543327616 00000100:00100000:2.0:1787599431.750172:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543327616 00000100:00100000:2.0:1787599431.750206:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599431.750213:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c58453450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+20:3299:x1874433543327232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599431.750238:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599431.750253:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751fec00/0xa46cbc67411825eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411825e4 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599431.750266:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599431.750306:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c58453450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3299:x1874433543327232:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (7956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599431.750313:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599431.750369:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787599431.750376:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:3300:x1874433543327616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599431.750384:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599431.750392:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d8c00/0xa46cbc67411825f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411825f2 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599431.750400:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599431.750422:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:3300:x1874433543327616:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599431.750428:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599431.750671:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543327616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599431.750705:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543327232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599431.750728:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543327744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599431.750754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599431.750775:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599431.750780:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543327872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599431.750800:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599431.750828:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543327360 00000100:00100000:3.0:1787599431.750833:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543327360 00000100:00100000:3.0:1787599431.750869:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543327488 00000100:00100000:3.0:1787599431.750873:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543327488 00000100:00100000:3.0:1787599431.750906:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787599431.750923:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874433543327360:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787599431.750947:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182455 00000100:00080000:3.0:1787599431.750954:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9f6c763f2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787599431.750987:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787599431.751353:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3298:x1874433543327360:12345-0@lo:9:umount.0 Request processed in 430us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599431.751373:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787599431.751391:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787599431.751398:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874433543327488:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787599431.751410:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc674118253c 00000100:00080000:3.0:1787599431.751416:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787599431.751436:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787599431.751628:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3298:x1874433543327488:12345-0@lo:9:umount.0 Request processed in 230us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599431.751635:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787599431.751656:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599431.751660:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787599431.751674:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787599431.751697:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c763f7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787599431.751709:0:3298:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787599431.751711:0:3298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787599431.751714:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543327360:0@lo:9:umount.0 00000100:00080000:3.0:1787599431.751726:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6b4664e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787599431.751735:0:3298:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787599431.751736:0:3298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787599431.751739:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543327488:0@lo:9:umount.0 00000100:00100000:3.0:1787599431.751766:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543328000 00000100:00100000:3.0:1787599431.751770:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543328000 00000100:00100000:3.0:1787599431.751801:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543327744 00000100:00100000:3.0:1787599431.751804:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543327744 00000100:00100000:3.0:1787599431.751814:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543327872 00000100:00100000:3.0:1787599431.751816:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543327872 00000100:00100000:3.0:1787599431.751828:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599431.751835:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+19:3300:x1874433543328000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599431.751843:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599431.751856:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c7d00ea00/0xa46cbc67411822c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411822bf expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.751872:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599431.751900:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+18:3300:x1874433543328000:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599431.751906:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599431.751917:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599431.751923:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+17:3301:x1874433543327744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599431.751931:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599431.751939:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d9a00/0xa46cbc6741182512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc674118250b expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.751949:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599431.751974:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+16:3301:x1874433543327744:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599431.751980:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599431.751992:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599431.751997:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+15:3301:x1874433543327872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599431.752004:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599431.752013:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751ff400/0xa46cbc6741182806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411827ff expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599431.752028:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599431.752050:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7+14:3301:x1874433543327872:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599431.752055:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599431.752080:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543328000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599431.752101:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543327872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599431.752108:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3301:1874433543327744:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599431.752129:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787599431.762636:0:13001:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f6c76714d28) has no exports 00000020:00000080:3.0:1787599431.819396:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc674118231a 00000020:00000080:3.0:1787599431.819412:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c50239800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787599431.819427:0:13001:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787599431.819573:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c50239800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787599431.819836:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599431.819847:0:13001:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787599431.819852:0:13001:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9f6c7f7bcd28) has no exports 00000020:00000080:2.0:1787599431.822216:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182313 00000020:00000080:2.0:1787599431.822228:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c7f7c0800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787599431.822781:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c7f7c0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787599431.823061:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599431.823074:0:13001:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787599431.823078:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c4fa5c000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787599431.823081:0:13001:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c4fa5c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787599431.823099:0:13001:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1787599431.823312:0:13001:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f6c760e1c60 - data ffff9f6c4b3170d8/ffff9f6b455e3000 00000020:01000000:2.0:1787599431.823656:0:13001:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f6c75617e40 - data ffff9f6c6c954ca8/ffff9f6c4fee2000 00000001:00000004:2.0:1787599431.866397:0:13001:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787599431.989079:0:13001:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787599431.989089:0:13001:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787599431.989114:0:13001:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787599431.989116:0:13001:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787599431.989571:0:6728:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787599431.989576:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787599431.989587:0:6728:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787599431.990771:0:13001:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787599431.990777:0:13001:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787599431.990797:0:13001:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787599431.990800:0:13001:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787599431.991088:0:8125:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787599431.991093:0:8125:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787599431.991102:0:8125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787599432.071823:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc67411822e2 00000020:00000080:2.0:1787599432.071835:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c4fa02800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787599432.071975:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c4fa02800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787599432.074932:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc67411822f7 00000020:00000080:2.0:1787599432.074946:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c76724000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787599432.075031:0:13001:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787599432.075040:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599432.075049:0:13001:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787599432.075054:0:13001:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9f6c7670cd28) has no exports 00000004:01000000:2.0:1787599432.075359:0:13001:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787599432.075369:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182535 00000020:00000080:2.0:1787599432.075375:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c81f34000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787599432.075379:0:13001:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787599432.075384:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599432.075391:0:13001:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787599432.075394:0:13001:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9f6c7f7bb370) has no exports 00000020:00000080:2.0:1787599432.075401:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc674118252e 00000020:00000080:2.0:1787599432.075404:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6b4664a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787599432.075762:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c76724000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787599432.075776:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c81f34000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787599432.075784:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b4664a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787599432.075842:0:13001:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787599432.075847:0:13001:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787599432.075864:0:13001:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787599432.075869:0:13001:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787599432.075872:0:13001:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787599432.075915:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599432.075924:0:13001:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599432.075929:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc674118244e 00000020:00000080:2.0:1787599432.075934:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6b44367800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787599432.075937:0:13001:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787599432.075941:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599432.075944:0:13001:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787599432.075946:0:13001:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9f6c7f7b99b8) has no exports 00000020:00000080:2.0:1787599432.075950:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182447 00000020:00000080:2.0:1787599432.075953:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c763f2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787599432.076600:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6b4664e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787599432.076610:0:36:0:(genops.c:885:class_export_put()) final put ffff9f6c81f30800/lustre-MDT0000-mdtlov_UUID 00010000:01000000:2.0:1787599432.076613:0:13001:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000020:00000080:0.0:1787599432.076613:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c81f30800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787599432.076622:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787599432.076707:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b44367800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787599432.076712:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c763f2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:2.0:1787599432.077882:0:13001:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787599432.077891:0:13001:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787599432.077899:0:13001:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787599432.077901:0:13001:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787599432.077986:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c763f7800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787599432.078291:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599432.078303:0:13001:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599432.078308:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6b44363800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599432.078311:0:13001:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b44363800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787599432.078318:0:13001:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599432.078473:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599432.078478:0:13001:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599432.078480:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c6a27e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599432.078483:0:13001:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c6a27e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787599432.078490:0:13001:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599432.078645:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc67411822fe 00000020:00000080:2.0:1787599432.078652:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c76723000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787599432.078788:0:13001:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787599432.078801:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599432.078807:0:13001:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787599432.078811:0:13001:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9f6c76710000) has no exports 00000020:00000080:2.0:1787599432.078836:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599432.078839:0:13001:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787599432.078843:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182305 00000020:00000080:2.0:1787599432.078848:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c76723800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787599432.078855:0:13001:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f6c6dd51000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787599432.078858:0:13001:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6c6dd51000 3 00000020:01000004:2.0:1787599432.078861:0:13001:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f6c6dd51000 from lustre-MDT0000 00000020:00000080:2.0:1787599432.078879:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599432.078882:0:13001:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787599432.078884:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c4fa05000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787599432.078886:0:13001:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c4fa05000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787599432.078895:0:13001:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787599432.078920:0:13001:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787599432.078923:0:13001:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787599432.078926:0:13001:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787599432.078928:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599432.078930:0:13001:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787599432.078942:0:13001:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9f6c50e40000 a65f327d-6cf7-4b01-bb9d-92abd32dc6c7 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787599432.078948:0:13001:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9f6c50f7cd28) has exports, disconnecting them 00000020:00080000:2.0:1787599432.078952:0:13001:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f6c50e40000), last request at 1787599193 00000020:00000080:2.0:1787599432.078975:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc67411822a3 00000020:00010000:2.0:1787599432.078978:0:13001:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f6c50e40000: total 2 00000100:00080000:2.0:1787599432.078982:0:13001:0:(import.c:65:import_set_state_nolock()) ffff9f6c50e44000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787599432.079059:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c76723000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787599432.079065:0:36:0:(genops.c:885:class_export_put()) final put ffff9f6c4fa06000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787599432.079067:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c4fa06000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787599432.079072:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00080000:2.0:1787599432.079101:0:13001:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f6c50e40000): rc 0 00000020:00080000:2.0:1787599432.079107:0:13001:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9f6c50f7cd28) has no exports 00000020:00000080:0.0:1787599432.079291:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c76723800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787599432.079342:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f6c4686ea00:5825] 1 exiting: rc = 0 00000020:00010000:1.0:1787599432.079387:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f6c50e40000: total 0 00010000:00010000:1.0:1787599432.079426:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f6c50e40000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787599432.079456:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24c000/0xa46cbc67411827f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411827f1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599432.079459:0:5824:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f6c6022a800:5824] 0 exiting: rc = 1 00010000:00010000:1.0:1787599432.079479:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c7d00f000/0xa46cbc67411823bb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411823b4 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599432.079500:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75618800/0xa46cbc6741182607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc6741182600 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599432.079514:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d9400/0xa46cbc67411825b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411825ac expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599432.079524:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d9800/0xa46cbc67411825c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411825ba expref: 5 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599432.079535:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751ff200/0xa46cbc67411827ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411827e3 expref: 4 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599432.079556:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c5b24dc00/0xa46cbc67411825cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411825c8 expref: 3 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599432.079566:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c582d8800/0xa46cbc67411825dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa46cbc67411825d6 expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599432.079575:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f6c50e40000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787599432.079589:0:5819:0:(genops.c:885:class_export_put()) final put ffff9f6c50e40000/a65f327d-6cf7-4b01-bb9d-92abd32dc6c7 00010000:00010000:1.0:1787599432.079605:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599432.079608:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599432.079609:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787599432.080042:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c50e40000/a65f327d-6cf7-4b01-bb9d-92abd32dc6c7 for MGS 00000020:00000080:0.0:1787599432.080079:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c50e44000 for MGS 00000100:00100000:0.0:1787599432.080656:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f6c4686e200:5826] 2 exiting: rc = 0 00000100:00100000:2.0:1787599432.081937:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.081948:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.081955:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.081975:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082001:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082007:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082014:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082022:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082028:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082034:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082041:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082047:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082053:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082060:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082066:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082072:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082078:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082084:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082090:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082097:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082103:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082110:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082117:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082122:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082140:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082146:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082152:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082175:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082181:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082190:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082197:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082203:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082208:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082213:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082221:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082227:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082232:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082237:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082242:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082255:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082260:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082266:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082272:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082277:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082283:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082288:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082293:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082298:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082303:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082308:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082313:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082318:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082324:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082329:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082335:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082340:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082346:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082364:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082371:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082377:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082383:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082389:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082394:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.082400:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787599432.082966:0:13001:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787599432.082970:0:13001:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787599432.087261:0:13001:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f6c763faba0 - data ffff9f6c4b3b3798/ffff9f6c4fe9f400 00000020:01000000:2.0:1787599432.087431:0:13001:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f6c5848fcc0 - data ffff9f6c6cbb4d80/ffff9f6c466e8400 00000020:00000080:2.0:1787599432.088360:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182287 00000020:00000080:2.0:1787599432.088369:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c5023f800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787599432.088389:0:13001:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f6c6dd51000 from MGS, refs=2 00000020:01000004:2.0:1787599432.088392:0:13001:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6c6dd51000 2 00000020:01000004:2.0:1787599432.088395:0:13001:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f6c6dd51000 from MGS 00000020:00000080:2.0:1787599432.088441:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599432.088448:0:13001:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787599432.088451:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c58395000/MGS 00000020:00000080:2.0:1787599432.088455:0:13001:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c58395000/MGS for MGS 00000020:01000000:2.0:1787599432.088466:0:13001:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1787599432.088470:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c5023f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787599432.088520:0:13001:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787599432.088525:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599432.088530:0:13001:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787599432.088537:0:13001:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f6c6a2a0800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787599432.088542:0:13001:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9f6c767119b8) has exports, disconnecting them 00000020:00080000:2.0:1787599432.088546:0:13001:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9f6c6a2a0800), last request at 1787599194 00000020:00000080:2.0:1787599432.088550:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182352 00000020:00080000:2.0:1787599432.088557:0:13001:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f6c6a2a0800): rc 0 00000020:00000080:2.0:1787599432.088562:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c6a2a0800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787599432.088675:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c6a2a0800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787599432.090218:0:13001:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787599432.090226:0:13001:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599432.090230:0:13001:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787599432.090236:0:13001:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787599432.090400:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599432.090408:0:13001:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787599432.090413:0:13001:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6c6dd51000 1 00000020:00000080:2.0:1787599432.090419:0:13001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182279 00000020:00000080:2.0:1787599432.090426:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c58393800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787599432.090432:0:13001:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787599432.090436:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599432.090439:0:13001:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787599432.090442:0:13001:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9f6c50f7b370) has no exports 00000020:00000080:1.0:1787599432.090626:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c4fa07800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787599432.090634:0:8:0:(genops.c:885:class_export_put()) final put ffff9f6c76727000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787599432.090637:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c76727000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787599432.090643:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787599432.090869:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c58393800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787599432.186030:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599432.186043:0:13001:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787599432.186053:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c58396000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787599432.186057:0:13001:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c58396000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787599432.186071:0:13001:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787599432.186743:0:13001:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f6c6dd54000 00000020:01000000:1.0:1787599432.186764:0:13001:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787599432.186770:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599432.186775:0:13001:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787599432.186779:0:13001:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9f6c50f799b8) has no exports 00000100:00100000:0.0:1787599432.187394:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9f6c466dda00:5831] 0 exiting: rc = 1 00000100:00100000:0.0:1787599432.187492:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9f6c50f11c00:5833] 2 exiting: rc = 0 00000100:00100000:3.0:1787599432.187790:0:8189:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9f6c4fe89a00:8189] 3 exiting: rc = 0 00000100:00100000:0.0:1787599432.188282:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9f6c5026fe00:5832] 1 exiting: rc = 0 00000100:00100000:1.0:1787599432.188526:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188535:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188541:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188547:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188553:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188559:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188567:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188572:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188578:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188584:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188589:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188595:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188600:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188605:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188611:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188631:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188638:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188645:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188649:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188654:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188660:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188665:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188671:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188677:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188682:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188688:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188693:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188698:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188704:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188710:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188715:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188721:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188726:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188731:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188737:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188754:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188760:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188765:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188771:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188777:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188783:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188788:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188794:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188799:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188805:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188810:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188816:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188822:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188828:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188834:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188839:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188845:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188850:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188856:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188862:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188868:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188873:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188879:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188885:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188891:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188896:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188904:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188910:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.188916:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.197891:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f6c50f10400:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1787599432.198257:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f6c43e9fa00:5835] 1 exiting: rc = 0 00000100:00100000:1.0:1787599432.198385:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198395:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198402:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198409:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198415:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198421:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198439:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198444:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198450:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198456:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198462:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198469:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198477:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198484:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198493:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198500:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198508:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198515:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198523:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198530:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198537:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198544:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198552:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198560:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198567:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198575:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198583:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198591:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198598:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198608:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198631:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198637:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198643:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198656:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198667:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198749:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198756:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198761:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198766:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198771:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198780:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198794:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198800:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198804:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198809:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198814:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198819:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198824:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198830:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198835:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198841:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198846:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198851:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198857:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198862:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198873:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198879:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198885:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198890:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198895:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198901:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198906:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198912:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.198917:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.199525:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9f6c43e9e200:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1787599432.199913:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9f6c45c79000:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1787599432.200078:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.200088:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.200095:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.200103:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201324:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201339:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201358:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201365:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201372:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201378:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201384:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201390:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201410:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201416:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201423:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201429:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201820:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201829:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201836:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201844:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201851:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201859:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201867:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201875:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201882:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201890:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201899:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201910:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201933:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201941:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201946:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201952:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201958:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201965:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201975:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201986:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.201993:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202008:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202048:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202054:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202080:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202088:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202094:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202101:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202109:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202114:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202120:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202147:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202154:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202217:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202224:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202229:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202251:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202258:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202264:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202270:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202275:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202286:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202293:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202299:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202305:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202312:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202318:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.202324:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.215000:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f6c45c78600:5838] 0 exiting: rc = 1 00000100:00100000:0.0:1787599432.215121:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f6c45c79400:5839] 1 exiting: rc = 0 00000100:00100000:1.0:1787599432.215412:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215419:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215425:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215430:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215436:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215442:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215447:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215453:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215458:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215464:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215469:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215474:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215479:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215485:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215490:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215496:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215500:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215505:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215520:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215525:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215530:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215535:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215540:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215546:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215551:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215557:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215562:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215568:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215574:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215580:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215585:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215590:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215594:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215600:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215606:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215611:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215689:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215697:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215703:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215708:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215714:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215719:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215725:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215730:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215735:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215741:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215746:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215752:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215757:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215763:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215779:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215786:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215792:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215807:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215814:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215822:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215829:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215836:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215846:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215854:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215862:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215871:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215879:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.215886:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599432.216823:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f6c45c78200:5840] 0 exiting: rc = 1 00000100:00100000:2.0:1787599432.216824:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f6c45c79c00:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1787599432.216948:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.216955:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.216960:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.216966:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.216972:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.216977:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.216982:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.216987:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.216992:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.216997:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217002:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217008:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217013:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217019:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217025:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217030:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217037:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217042:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217048:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217052:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217058:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217064:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217070:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217075:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217090:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217094:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217099:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217104:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217109:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217114:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217120:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217235:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217242:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217247:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217253:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217258:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217263:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217268:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217273:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217277:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217282:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217286:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217291:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217296:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217300:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217304:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217309:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217314:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217318:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217324:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217329:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217334:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217339:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217344:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217361:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217367:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217372:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217377:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217383:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217396:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217401:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217406:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217411:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.217416:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.217946:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f6c45c79800:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1787599432.218081:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f6c45c78400:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1787599432.218312:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218319:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218326:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218334:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218341:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218358:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218364:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218369:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218375:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218380:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218386:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218392:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218396:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218401:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218406:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218411:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218416:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218421:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218427:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218433:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218438:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218444:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218450:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218455:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218460:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218466:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218471:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218477:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218482:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218487:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218503:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218509:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218514:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218520:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218525:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218531:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218536:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218541:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218546:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218552:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218557:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218562:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218567:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218573:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218579:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218584:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218589:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218593:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218597:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218602:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218607:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218612:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218698:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218706:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218717:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218760:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218767:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218772:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218777:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218782:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218787:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218793:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218798:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.218805:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599432.219509:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9f6c6a26d400:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1787599432.219714:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9f6c6a26f000:5846] 2 exiting: rc = 0 00000100:00100000:0.0:1787599432.219986:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9f6c6a26ca00:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1787599432.220109:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220318:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220330:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220339:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220362:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220371:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220377:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220382:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220388:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220393:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220399:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220404:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220410:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220416:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220422:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220428:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220434:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220440:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220446:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220452:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220459:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220465:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220484:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220493:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220502:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220509:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220517:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220524:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220533:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220541:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220549:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220557:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220565:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220573:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220581:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220589:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220605:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220613:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220722:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220728:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220733:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220739:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220745:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220751:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220756:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220763:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220794:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220804:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220814:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220821:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220830:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220838:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220846:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220854:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220863:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220871:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220878:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220886:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220894:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220902:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220909:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220916:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220923:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599432.220929:0:13001:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787599432.231378:0:13001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599432.231393:0:13001:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787599432.231399:0:13001:0:(genops.c:885:class_export_put()) final put ffff9f6c5023e000/MDS_uuid 00000020:00000080:2.0:1787599432.231405:0:13001:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c5023e000/MDS_uuid for MDS 00000020:01000000:2.0:1787599432.231413:0:13001:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787599432.231564:0:13001:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787599432.678323:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599433.698728:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599434.724310:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599434.787834:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543328128:0@lo:400:kworker.0 00000400:00000100:0.0:1787599434.787916:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874433543328128 offset 0 length 224: 4 00000100:00100000:3.0:1787599434.788079:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543328384:0@lo:400:kworker.0 00000400:00000100:3.0:1787599434.788109:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433543328384 offset 0 length 224: 4 00000100:00100000:3.0:1787599434.788132:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599434.788138:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543328256:0@lo:400:kworker.0 00000400:00000100:3.0:1787599434.788182:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433543328256 offset 0 length 224: 4 00000020:01000004:3.0:1787599435.092519:0:13151:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787599435.109603:0:13151:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787599435.109678:0:13151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599435.109697:0:13151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599435.109730:0:13151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599435.109738:0:13151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599435.109761:0:13151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787599435.109767:0:13151:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787599435.109801:0:13151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787599435.109828:0:13151:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f6c7609f100 x1874433543328256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599450 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599435.109858:0:13151:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787599435.109867:0:13151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787599435.109903:0:13151:0:(import.c:65:import_set_state_nolock()) ffff9f6b44a79000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787599435.109963:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874433543328512:0@lo:39:umount.0 00000400:00000100:2.0:1787599435.110030:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433543328512 offset 0 length 224: 4 00000100:00100000:0.0:1787599435.110427:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543328256:0@lo:400:kworker.0 00010000:00010000:1.0:1787599435.110594:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599435.110605:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599435.110616:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c582d9c00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599435.110631:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599435.110643:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599435.110652:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599435.110658:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787599435.110660:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787599435.110663:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787599435.110698:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599435.110705:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599435.110728:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599435.110735:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c582d9c00/0xa46cbc67411825c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa46cbc67411825cf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599435.110747:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599435.110749:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599435.110751:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599435.110772:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543328640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599435.110897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599435.110966:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543328640 00000100:00100000:2.0:1787599435.110975:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543328640 00000100:00100000:2.0:1787599435.111037:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787599435.111047:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3299:x1874433543328640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787599435.111056:0:5818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599435 with bad export cookie 11848051871364686499 00000100:00100000:3.0:1787599435.122865:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3299:x1874433543328640:12345-0@lo:103:ldlm_bl.0 Request processed in 11804us (11955us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787599435.122950:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787599435.123041:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787599435.123049:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9f6c5023a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787599435.123054:0:3299:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787599435.133934:0:3299:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.130@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787599435.133942:0:3299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787599435.133980:0:3299:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f6c7609d180 x1874433543328128/t0(0) o400->MGC192.168.204.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787599450 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599435.134323:0:3299:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f6c76121180 x1874433543328640/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599451 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787599435.134336:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787599435.134339:0:3299:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787599435.134341:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787599435.134346:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9f6c5023a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599435.134351:0:3299:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 150 00000100:00080000:1.0:1787599435.134363:0:3299:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff9f6c5023a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787599435.134575:0:3299:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c75dead80 x1874433543328768/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599435.134622:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3299:1874433543328640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599435.134786:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3300:1874433543328128:0@lo:400:kworker.0 00000100:00100000:2.0:1787599435.134961:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3298:1874433543328768:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1787599435.135036:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874433543328768 offset 0 length 520: 4 00010000:00010000:3.0:1787599435.745993:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787599435.865209:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599435.865217:0:7625:0:(genops.c:885:class_export_put()) final put ffff9f6c76629000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787599435.865293:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c76629000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787599435.865351:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c7662c800 for lustre-OST0001 00000001:00100000:1.0:1787599435.866479:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787599435.866486:0:6704:0:(genops.c:885:class_export_put()) final put ffff9f6c763f6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599435.866539:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c763f6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787599435.866590:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c763f2000 for lustre-OST0000 00010000:00010000:1.0:1787599436.771850:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599437.793421:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599438.819188:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599439.841735:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599439.907645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599439.907656:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787599439.907826:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599439.907846:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543328896:0@lo:400:kworker.0 00000400:00000100:0.0:1787599439.907907:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433543328896 offset 0 length 224: 4 00010000:00010000:1.0:1787599440.866881:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599441.889391:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599442.913401:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599443.937470:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599444.963097:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599445.025279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599445.025306:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787599445.025482:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599445.025502:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543329024:0@lo:400:kworker.0 00000400:00000100:0.0:1787599445.025556:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433543329024 offset 0 length 224: 4 00000100:00100000:3.0:1787599445.537407:0:3298:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599435/real 1787599435] req@ffff9f6c75dead80 x1874433543328768/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787599445 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599445.537459:0:3298:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f6c75dead80 x1874433543328768/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787599445 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599445.537483:0:3298:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599435/real 1787599435] req@ffff9f6c7609df80 x1874433543328512/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599445 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599445.537495:0:3298:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f6c7609df80 x1874433543328512/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599445 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787599445.537514:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c5023a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599445.537542:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787599445.537546:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3298:1874433543328768:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1787599445.537552:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6b44a79000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787599445.537569:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874433543328512:0@lo:39:umount.0 00000100:00080000:0.0:1787599445.537719:0:13151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787599445.537725:0:13151:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787599445.537730:0:13151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787599445.538741:0:13151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599445.538758:0:13151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599445.538776:0:13151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599445.538783:0:13151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599445.538808:0:13151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599445.538815:0:13151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599445.538822:0:13151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599445.538829:0:13151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599445.538835:0:13151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599445.538855:0:13151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787599445.538859:0:13151:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787599445.538881:0:13151:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787599445.538885:0:13151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787599445.538890:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599445.538895:0:13151:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787599445.538899:0:13151:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9f6c7f7b8000) has no exports 00000020:00080000:0.0:1787599445.538926:0:13151:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9f6c7f7b8000) has no exports 00000100:00080000:2.0:1787599445.539442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599445.539447:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787599445.539450:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f6c5023a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599445.539457:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 392 00000100:00080000:2.0:1787599445.539479:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787599445.539485:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff9f6c5023a000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787599445.539517:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c466eed80 x1874433543329152/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1787599445.539811:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599445.539819:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599445.539828:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24cc00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599445.539831:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599445.539841:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599445.539848:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599445.539867:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787599445.539870:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787599445.539872:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787599445.539886:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f6c5023a000 00010000:00010000:1.0:1787599445.539890:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599445.539897:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24cc00/0xa46cbc67411825d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411825dd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599445.539910:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599445.539914:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599445.539919:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fe600 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599445.539921:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599445.539927:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599445.539932:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599445.539937:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787599445.539938:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787599445.539940:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787599445.539944:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f6c5023a000 00010000:00010000:1.0:1787599445.539946:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599445.539958:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe600/0xa46cbc67411827f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411827f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599445.539980:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599445.539981:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599445.539983:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599445.540497:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599445.540515:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3298:1874433543329152:0@lo:250:kworker.0 00000400:00000100:3.0:1787599445.540566:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874433543329152 offset 0 length 520: 4 00000020:01000000:0.0:1787599445.546047:0:13151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f6c760e1060 - data ffff9f6c6cbed360/ffff9f6c759d6400 00000020:01000000:0.0:1787599445.546268:0:13151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f6c58290ae0 - data ffff9f6c6cbc1948/ffff9f6b44331000 00100000:10000000:0.0:1787599445.559505:0:13151:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787599445.615646:0:13151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc67411823d7 00000020:00000080:3.0:1787599445.615655:0:13151:0:(genops.c:885:class_export_put()) final put ffff9f6b44363000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787599445.615669:0:13151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f6c50231800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787599445.615672:0:13151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6c50231800 2 00000020:01000004:3.0:1787599445.615675:0:13151:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f6c50231800 from lustre-OST0000 00000020:00000080:3.0:1787599445.615701:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599445.615712:0:13151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787599445.615715:0:13151:0:(genops.c:885:class_export_put()) final put ffff9f6b44365800/lustre-OST0000_UUID 00000020:00000080:3.0:1787599445.615717:0:13151:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b44365800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787599445.615723:0:13151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787599445.615783:0:13151:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787599445.615787:0:13151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787599445.615790:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599445.615795:0:13151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787599445.615801:0:13151:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9f6b44a7c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787599445.615807:0:13151:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9f6b44a73370) has exports, disconnecting them 00000020:00080000:3.0:1787599445.615811:0:13151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9f6b44a7c800), last request at 1787599211 00000020:00000080:3.0:1787599445.615814:0:13151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182401 00000020:00080000:3.0:1787599445.615823:0:13151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f6b44a7c800): rc 0 00000020:00000080:3.0:1787599445.615828:0:13151:0:(genops.c:885:class_export_put()) final put ffff9f6b44a7c800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787599445.616533:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b44363000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787599445.616553:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b44a7c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787599445.617319:0:13151:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787599445.617324:0:13151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787599445.617328:0:13151:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787599445.617333:0:13151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787599445.618033:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599445.618053:0:13151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787599445.618060:0:13151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6c50231800 1 00000020:00000080:0.0:1787599445.618066:0:13151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182391 00000020:00000080:0.0:1787599445.618074:0:13151:0:(genops.c:885:class_export_put()) final put ffff9f6c7f7c4800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787599445.618955:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6b44a79000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787599445.618966:0:36:0:(genops.c:885:class_export_put()) final put ffff9f6c76724800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787599445.618969:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c76724800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787599445.618982:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787599445.619590:0:13151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787599445.619597:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599445.619605:0:13151:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787599445.619609:0:13151:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9f6c483319b8) has no exports 00000020:00000080:1.0:1787599445.619743:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c7f7c4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787599445.691550:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599445.691564:0:13151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787599445.691569:0:13151:0:(genops.c:885:class_export_put()) final put ffff9f6c50235000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787599445.691574:0:13151:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c50235000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787599445.691591:0:13151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787599445.691724:0:13151:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f6c50230000 00000020:02000400:0.0:1787599445.692520:0:13151:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787599445.990032:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599447.010368:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599448.033404:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599449.061716:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787599449.070859:0:13306:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787599449.088912:0:13306:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787599449.088991:0:13306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599449.089007:0:13306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599449.089015:0:13306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599449.089033:0:13306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599449.089059:0:13306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787599449.089065:0:13306:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787599449.089087:0:13306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787599449.089099:0:13306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f6c7609f480 x1874433543328384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599450 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599449.089136:0:13306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f6c466edf80 x1874433543328896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599455 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599449.089151:0:13306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f6c466eea00 x1874433543329024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599461 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599449.089179:0:13306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1787599449.089223:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543328896:0@lo:400:kworker.0 00000100:00080000:3.0:1787599449.089254:0:13306:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787599449.089277:0:13306:0:(import.c:65:import_set_state_nolock()) ffff9f6c76720000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787599449.089304:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874433543329280:0@lo:39:umount.0 00000400:00000100:3.0:1787599449.089350:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433543329280 offset 0 length 224: 4 00010000:00010000:0.0:1787599449.089681:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599449.089688:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599449.089696:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff000 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:0.0:1787599449.089700:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599449.089720:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599449.089727:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599449.089733:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599449.089735:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787599449.089737:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787599449.089751:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f6c5023a000 00010000:00010000:0.0:1787599449.089755:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599449.089761:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411825ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411825b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599449.089772:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599449.089774:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599449.089776:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599449.089857:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543329024:0@lo:400:kworker.0 00000100:00100000:2.0:1787599449.089866:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543328384:0@lo:400:kworker.0 00010000:00010000:3.0:1787599450.084073:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787599450.657281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787599450.657291:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787599451.107201:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599452.129370:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599453.154205:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599454.177699:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599455.201532:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599455.777387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599455.777396:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787599456.229850:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599457.249495:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599458.273438:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599459.298517:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599459.369007:0:3298:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599449/real 1787599449] req@ffff9f6c7609df80 x1874433543329280/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599459 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599459.369041:0:3298:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f6c7609df80 x1874433543329280/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599459 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787599459.369060:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c76720000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787599459.369118:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874433543329280:0@lo:39:umount.0 00000100:00080000:2.0:1787599459.373877:0:13306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599459.373887:0:13306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787599459.373894:0:13306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787599459.375710:0:13306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.375728:0:13306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.375736:0:13306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.375760:0:13306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.375791:0:13306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599459.375797:0:13306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.375804:0:13306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.375811:0:13306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.375817:0:13306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599459.375896:0:13306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787599459.375901:0:13306:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787599459.375961:0:13306:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787599459.375965:0:13306:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787599459.375970:0:13306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599459.375975:0:13306:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787599459.375979:0:13306:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9f6c48333370) has no exports 00000020:00080000:2.0:1787599459.376017:0:13306:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9f6c48333370) has no exports 00010000:00010000:3.0:1787599459.377090:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599459.377103:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599459.377128:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618a00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599459.377133:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599459.377330:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599459.377432:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599459.377440:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599459.377446:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787599459.377449:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787599459.377452:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787599459.377468:0:5820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f6c5023a000 00010000:00010000:3.0:1787599459.377471:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599459.377479:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75618a00/0xa46cbc67411825ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411825c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599459.377492:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599459.377494:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599459.377496:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787599459.377724:0:13306:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f6c75c663c0 - data ffff9f6c4b3960d8/ffff9f6b44156400 00000020:01000000:2.0:1787599459.377916:0:13306:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f6c763fa660 - data ffff9f6c4b3e3948/ffff9f6b455b5c00 00010000:00010000:2.0:1787599459.380924:0:13308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599459.380930:0:13308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599459.380932:0:13308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599459.380979:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599459.380992:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75618200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:0.0:1787599459.381001:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599459.381012:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599459.381020:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599459.381026:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787599459.381029:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787599459.381033:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787599459.381048:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f6c5023a000 00010000:00010000:0.0:1787599459.381052:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599459.381058:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75618200/0xa46cbc67411827e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411827ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599459.381076:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599459.381078:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599459.381080:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787599459.398783:0:13306:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787599459.440014:0:13306:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc67411824a2 00000020:00000080:3.0:1787599459.440025:0:13306:0:(genops.c:885:class_export_put()) final put ffff9f6b4664d000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787599459.440052:0:13306:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f6b4432d000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787599459.440056:0:13306:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6b4432d000 2 00000020:01000004:3.0:1787599459.440059:0:13306:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f6b4432d000 from lustre-OST0001 00000020:00000080:3.0:1787599459.440086:0:13306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599459.440112:0:13306:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787599459.440116:0:13306:0:(genops.c:885:class_export_put()) final put ffff9f6c70850800/lustre-OST0001_UUID 00000020:00000080:3.0:1787599459.440119:0:13306:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c70850800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787599459.440125:0:13306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1787599459.440310:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b4664d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1787599459.440399:0:13306:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a65f327d-6cf7-4b01-bb9d-92abd32dc6c7->MGS 00010000:00010000:3.0:1787599459.440414:0:13306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00e800/0xa46cbc67411823b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc67411823bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599459.440435:0:13306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00e800/0xa46cbc67411823b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc67411823bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599459.440443:0:13306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787599459.440445:0:13306:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787599459.440449:0:13306:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787599459.440813:0:13306:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f6c5023a000 00010000:00010000:3.0:1787599459.440818:0:13306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c7d00e800/0xa46cbc67411823b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc67411823bb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599459.440848:0:13306:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ca00/0xa46cbc6741182600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa46cbc6741182607 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599459.440856:0:13306:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ca00/0xa46cbc6741182600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa46cbc6741182607 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599459.440861:0:13306:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787599459.440863:0:13306:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787599459.440865:0:13306:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787599459.440874:0:13306:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f6c5023a000 00010000:00010000:3.0:1787599459.440876:0:13306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24ca00/0xa46cbc6741182600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa46cbc6741182607 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787599459.440891:0:13306:0:(import.c:65:import_set_state_nolock()) ffff9f6c5023a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787599459.440902:0:13306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787599459.440904:0:13306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787599459.440906:0:13306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787599459.440909:0:13306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787599459.440920:0:13306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f6c466eed80 x1874433543329152/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787599460 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787599459.440987:0:13306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787599459.440991:0:13306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:2.0:1787599459.448065:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a65f327d-6cf7-4b01-bb9d-92abd32dc6c7:3298:1874433543329152:0@lo:250:kworker.0 10000000:01000000:3.0:1787599459.449221:0:13306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787599459.449402:0:13306:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182295 00000020:00000080:3.0:1787599459.449413:0:13306:0:(genops.c:885:class_export_put()) final put ffff9f6c5023e800/a65f327d-6cf7-4b01-bb9d-92abd32dc6c7 00000020:01000000:3.0:1787599459.454001:0:13306:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.130@tcp (flags='') 00000020:00000080:3.0:1787599459.454019:0:13306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599459.454028:0:13306:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787599459.454034:0:13306:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9f6c50f78000) has no exports 10000000:01000000:3.0:1787599459.454067:0:5828:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787599459.454194:0:13306:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.130@tcp: client import never connected 00000100:00080000:3.0:1787599459.454198:0:13306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787599459.454202:0:13306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787599459.454205:0:13306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787599459.454207:0:13306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787599459.454847:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c5023e800/a65f327d-6cf7-4b01-bb9d-92abd32dc6c7 for MGC192.168.204.130@tcp 00000020:00000080:3.0:1787599459.456140:0:13306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599459.456153:0:13306:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.130@tcp (uuid a65f327d-6cf7-4b01-bb9d-92abd32dc6c7) 00000020:01000000:3.0:1787599459.456175:0:13306:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787599459.456183:0:13306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599459.456188:0:13306:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787599459.456194:0:13306:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9f6c763f3000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787599459.456201:0:13306:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9f6c48334d28) has exports, disconnecting them 00000020:00080000:3.0:1787599459.456207:0:13306:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9f6c763f3000), last request at 1787599231 00000020:00000080:3.0:1787599459.456211:0:13306:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc67411824cc 00000020:00080000:3.0:1787599459.456397:0:13306:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f6c763f3000): rc 0 00000020:00000080:3.0:1787599459.456403:0:13306:0:(genops.c:885:class_export_put()) final put ffff9f6c763f3000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787599459.457184:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c5023a000 for MGC192.168.204.130@tcp 00000020:00000080:1.0:1787599459.457194:0:36:0:(genops.c:885:class_export_put()) final put ffff9f6c50238800/a65f327d-6cf7-4b01-bb9d-92abd32dc6c7 00000020:00000080:1.0:1787599459.457198:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c50238800/a65f327d-6cf7-4b01-bb9d-92abd32dc6c7 for MGC192.168.204.130@tcp 00000020:01000000:1.0:1787599459.457206:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.130@tcp (a65f327d-6cf7-4b01-bb9d-92abd32dc6c7) 00000020:00000080:1.0:1787599459.458043:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c763f3000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787599459.460273:0:13306:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787599459.460280:0:13306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599459.460289:0:13306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787599459.460330:0:13306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787599459.461912:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f6c76720000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787599459.463923:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787599459.464268:0:13308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787599459.465212:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787599459.465465:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9f6c430aea00:5815] 1 exiting: rc = 0 00000100:00100000:2.0:1787599459.467867:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9f6c430afa00:5814] 0 exiting: rc = 1 00000100:00100000:2.0:1787599459.473640:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.476750:0:8431:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9f6c4fe8d600:8431] 3 exiting: rc = 0 00000100:00100000:3.0:1787599459.477115:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9f6c430afc00:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1787599459.481192:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9f6c430af000:5817] 1 exiting: rc = 0 00000100:00100000:3.0:1787599459.485068:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9f6c465bec00:5818] 2 exiting: rc = 0 00000100:00100000:1.0:1787599459.489437:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489451:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489457:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489464:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489479:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489485:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489491:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489499:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489505:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489511:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489517:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489522:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489529:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489535:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489545:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489551:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489558:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489564:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489569:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489575:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489581:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489586:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489592:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489597:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489601:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489606:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489610:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489615:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489620:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489625:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489630:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489635:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489640:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489645:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489650:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489847:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489853:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489858:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489864:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489868:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489873:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489878:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489883:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489887:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489892:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489898:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489903:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489908:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489913:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489918:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489923:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489928:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489932:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489937:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489943:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489948:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489953:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489958:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489963:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489968:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489973:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489979:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489984:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.489990:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787599459.493514:0:13306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599459.493526:0:13306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787599459.493532:0:13306:0:(genops.c:885:class_export_put()) final put ffff9f6b46648000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787599459.493537:0:13306:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b46648000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787599459.493542:0:13306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787599459.493604:0:13306:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6b4432d000 1 00000020:00000080:1.0:1787599459.493611:0:13306:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa46cbc6741182471 00000020:00000080:1.0:1787599459.493616:0:13306:0:(genops.c:885:class_export_put()) final put ffff9f6b44328800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787599459.493633:0:13306:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787599459.493637:0:13306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599459.493641:0:13306:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787599459.493645:0:13306:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9f6c76708000) has no exports 00000020:00000080:2.0:1787599459.493903:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b44328800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787599459.516102:0:13306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599459.516119:0:13306:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787599459.516125:0:13306:0:(genops.c:885:class_export_put()) final put ffff9f6b4432f800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787599459.516130:0:13306:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6b4432f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787599459.516138:0:13306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787599459.516737:0:13306:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f6b4432a800 00000020:01000000:2.0:1787599459.516764:0:13306:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787599459.516769:0:13306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599459.516773:0:13306:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787599459.516777:0:13306:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9f6c76713370) has no exports 00000020:00000080:2.0:1787599459.516799:0:13306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599459.516808:0:13306:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787599459.516811:0:13306:0:(genops.c:885:class_export_put()) final put ffff9f6c7f7c4000/OSS_uuid 00000020:00000080:2.0:1787599459.516814:0:13306:0:(genops.c:844:class_export_destroy()) destroying export ffff9f6c7f7c4000/OSS_uuid for OSS 00000020:01000000:2.0:1787599459.516818:0:13306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787599459.517248:0:11786:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9f6c4fa70c00:11786] 3 exiting: rc = 0 00000100:00100000:2.0:1787599459.517340:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9f6c6a5ade00:6677] 0 exiting: rc = 1 00000100:00080000:2.0:1787599459.517377:0:5827:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787599459.517830:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9f6c6a5ac000:6678] 1 exiting: rc = 0 00000100:00100000:3.0:1787599459.517882:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9f6c4fe8c200:6679] 2 exiting: rc = 0 00000100:00100000:2.0:1787599459.518024:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518039:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518057:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518063:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518069:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518075:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518081:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518086:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518092:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518098:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518103:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518108:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518113:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518117:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518122:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518127:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518132:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518138:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518143:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518148:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518153:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518176:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518193:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518199:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518204:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518209:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518213:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518218:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518223:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518228:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518234:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518239:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518244:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518248:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518253:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518259:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518264:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518276:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518282:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518287:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518292:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518297:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518302:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518307:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518312:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518318:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518324:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518330:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518335:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518341:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518346:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518351:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518357:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518362:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518367:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518372:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518378:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518384:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518389:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518394:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518400:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518405:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518411:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.518416:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.519298:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9f6c75c05c00:6681] 1 exiting: rc = 0 00000100:00100000:0.0:1787599459.519552:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9f6c75c04200:6680] 0 exiting: rc = 1 00000100:00100000:0.0:1787599459.519606:0:12105:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9f6c468e2c00:12105] 2 exiting: rc = 0 00000100:00100000:2.0:1787599459.520517:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520526:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520643:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520652:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520657:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520662:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520666:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520684:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520689:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520694:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520699:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520704:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520709:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520714:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520719:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520725:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520731:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520735:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520740:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520745:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520750:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520755:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520760:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520766:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520771:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520776:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520782:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520788:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520793:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520799:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520804:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520810:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520815:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520833:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520839:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520844:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520850:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520856:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520862:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520868:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520874:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520879:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520893:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520898:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520903:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520909:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520915:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520921:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520926:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520931:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520937:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520943:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520948:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520954:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520959:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520965:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520972:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520978:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520983:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520989:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.520995:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.521001:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.521008:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.521013:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.522292:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9f6c7545ee00:6684] 2 exiting: rc = 0 00000100:00100000:0.0:1787599459.524202:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9f6c6a5ad600:6682] 0 exiting: rc = 1 00000100:00100000:2.0:1787599459.525287:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9f6c7545f800:6683] 1 exiting: rc = 0 00000100:00100000:2.0:1787599459.528123:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528377:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528393:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528399:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528405:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528410:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528416:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528422:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528428:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528434:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528439:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528461:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528467:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528474:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528480:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528498:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528504:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528510:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528516:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528521:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528527:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528532:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528537:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528543:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528549:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528555:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528560:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528566:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528571:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528576:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528582:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528587:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528592:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528598:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528603:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528609:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528614:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528620:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528625:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528642:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528648:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528653:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528659:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528665:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528670:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528676:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.528685:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.531834:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532472:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532479:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532485:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532491:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532498:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532503:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532559:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532565:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532572:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532578:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532584:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532609:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532616:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532622:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532628:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.532634:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549211:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9f6c75c04400:6685] 0 exiting: rc = 1 00000100:00100000:2.0:1787599459.549355:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9f6c75c05800:6686] 1 exiting: rc = 0 00000100:00100000:2.0:1787599459.549425:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549433:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549438:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549444:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549450:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549455:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549461:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549467:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549473:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549477:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549482:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549488:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549493:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549498:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549503:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549524:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549529:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549534:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.549540:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.555147:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.555168:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.555177:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.555184:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557093:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557108:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557116:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557128:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557133:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557138:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557143:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557149:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557154:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557171:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557178:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557186:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557314:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557350:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557359:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557366:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557372:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557377:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557394:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557403:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557409:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557416:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557424:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557432:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557437:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557442:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557449:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557479:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557487:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557494:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557502:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557509:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557520:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.557526:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.558175:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.558300:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.558311:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.558318:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.558326:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.558335:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599459.558347:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599459.561884:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9f6c70aff000:6688] 1 exiting: rc = 0 00000100:00100000:2.0:1787599459.564138:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9f6c70affe00:6687] 0 exiting: rc = 1 00000100:00100000:3.0:1787599459.564234:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564246:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564254:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564262:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564289:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564297:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564321:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564328:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564337:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564346:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564353:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564362:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564370:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564375:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564382:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564389:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564411:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564419:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564425:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564431:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.564437:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565778:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565791:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565798:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565804:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565812:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565837:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565845:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565873:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565882:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565900:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565906:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565912:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565917:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565923:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565929:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565935:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.565941:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566018:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566025:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566046:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566052:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566058:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566064:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566073:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566082:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566089:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566095:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566102:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566110:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566118:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566127:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566150:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566176:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566183:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566190:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566196:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566202:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566208:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566214:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566233:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566242:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566248:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599459.566255:0:13306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787599459.577611:0:13306:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787599481.711878:0:13924:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787599492.565695:0:14387:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787599492.565702:0:14387:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787599492.565857:0:14387:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f6b45127800 00000020:01000004:2.0:1787599492.565880:0:14387:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787599492.565890:0:14387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787599492.565912:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f6b44a74d28) 00000020:00000080:2.0:1787599492.565941:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787599492.606677:0:14387:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787599492.609112:0:14387:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787599492.609750:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 415: rc = 0 00100000:10000000:3.0:1787599492.609966:0:14387:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787599492.610040:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 415: rc = 0 00100000:10000000:3.0:1787599492.610269:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 415: rc = 0 00100000:10000000:3.0:1787599492.610462:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 415: rc = 0 00100000:10000000:3.0:1787599492.610564:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 415: rc = 0 00100000:10000000:3.0:1787599492.610655:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 415: rc = 0 00100000:10000000:3.0:1787599492.610925:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 417: rc = 0 00100000:10000000:3.0:1787599492.617135:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 553: rc = 0 00100000:10000000:3.0:1787599492.617320:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 553: rc = 0 00100000:10000000:3.0:1787599492.620829:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 187: rc = 0 00100000:10000000:3.0:1787599492.621559:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 187: rc = 0 00100000:10000000:3.0:1787599492.621831:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 187: rc = 0 00100000:10000000:3.0:1787599492.628751:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 187: rc = 0 00100000:10000000:0.0:1787599492.636744:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 187: rc = 0 00100000:10000000:0.0:1787599492.637090:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 187: rc = 0 00100000:10000000:0.0:1787599492.637429:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 187: rc = 0 00100000:10000000:0.0:1787599492.637709:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 187: rc = 0 00100000:10000000:0.0:1787599492.637970:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 187: rc = 0 00100000:10000000:0.0:1787599492.638283:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 187: rc = 0 00100000:10000000:0.0:1787599492.638557:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 187: rc = 0 00100000:10000000:3.0:1787599492.656294:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 187: rc = 0 00100000:10000000:2.0:1787599492.659813:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 774: rc = 0 00100000:10000000:2.0:1787599492.661896:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 774: rc = 0 00100000:10000000:2.0:1787599492.663674:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 774: rc = 0 00100000:10000000:2.0:1787599492.663934:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 774: rc = 0 00100000:10000000:2.0:1787599492.670264:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 774: rc = 0 00100000:10000000:2.0:1787599492.670833:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 774: rc = 0 00100000:10000000:2.0:1787599492.671098:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 774: rc = 0 00100000:10000000:2.0:1787599492.681091:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 774: rc = 0 00100000:10000000:2.0:1787599492.681462:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 774: rc = 0 00100000:10000000:2.0:1787599492.684978:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 774: rc = 0 00100000:10000000:2.0:1787599492.685370:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 774: rc = 0 00100000:10000000:2.0:1787599492.685641:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 774: rc = 0 00100000:10000000:2.0:1787599492.685894:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 774: rc = 0 00100000:10000000:2.0:1787599492.686142:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 774: rc = 0 00100000:10000000:3.0:1787599492.690888:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 774: rc = 0 00100000:10000000:3.0:1787599492.691715:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 774: rc = 0 00100000:10000000:3.0:1787599492.692897:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 774: rc = 0 00100000:10000000:3.0:1787599492.693917:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 774: rc = 0 00100000:10000000:3.0:1787599492.694774:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 774: rc = 0 00100000:10000000:3.0:1787599492.695549:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 774: rc = 0 00100000:10000000:3.0:1787599492.696227:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 774: rc = 0 00100000:10000000:3.0:1787599492.696615:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 774: rc = 0 00100000:10000000:3.0:1787599492.696894:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 774: rc = 0 00100000:10000000:3.0:1787599492.697563:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 774: rc = 0 00100000:10000000:3.0:1787599492.697867:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 774: rc = 0 00100000:10000000:3.0:1787599492.700320:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 774: rc = 0 00100000:10000000:3.0:1787599492.700936:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 774: rc = 0 00100000:10000000:3.0:1787599492.707950:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 774: rc = 0 00100000:10000000:3.0:1787599492.711847:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 774: rc = 0 00100000:10000000:3.0:1787599492.712752:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 774: rc = 0 00100000:10000000:3.0:1787599492.713223:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 774: rc = 0 00100000:10000000:3.0:1787599492.715923:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 774: rc = 0 00100000:10000000:3.0:1787599492.716892:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 650: rc = 0 00100000:10000000:3.0:1787599492.720890:0:14387:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787599492.721110:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 182: rc = 0 00100000:10000000:2.0:1787599492.725736:0:14387:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787599492.725919:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 182: rc = 0 00100000:10000000:2.0:1787599492.726242:0:14387:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787599492.726318:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 182: rc = 0 00100000:10000000:2.0:1787599492.726915:0:14387:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787599492.727710:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 554: rc = 0 00100000:10000000:2.0:1787599492.728621:0:14387:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787599492.728745:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 554: rc = 0 00100000:10000000:2.0:1787599492.729657:0:14387:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787599492.729762:0:14387:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 554: rc = 0 00000020:00000080:2.0:1787599492.730120:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787599492.730130:0:14387:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787599492.730144:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc6741183596 00000020:01000004:2.0:1787599492.730178:0:14387:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787599492.730198:0:14387:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787599492.730205:0:14387:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f6b45127800 from MGS 00000020:01000004:2.0:1787599492.730210:0:14387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787599492.730221:0:14387:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f6b44a70000) 00000020:00000080:2.0:1787599492.730232:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787599492.730293:0:14387:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6b45127800 from MGS, refs=2 00080000:01000000:2.0:1787599492.730297:0:14387:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787599492.730302:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc67411835a4 00000100:00100000:2.0:1787599492.730406:0:14387:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787599492.732330:0:14387:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787599492.732485:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787599492.733915:0:14387:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787599492.733932:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787599492.735129:0:14387:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599492.735731:0:14387:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787599492.735741:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787599492.738822:0:14387:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787599492.738841:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787599492.740848:0:14387:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787599492.740864:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787599492.742096:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599492.742102:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599492.742104:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599492.742750:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599492.742754:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599492.742756:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599492.743326:0:14387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787599492.748127:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787599492.773326:0:14387:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787599492.773353:0:14387:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787599492.773357:0:14387:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787599492.799569:0:14397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787599492.799924:0:14387:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787599492.800057:0:14387:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787599492.801790:0:14387:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787599492.803798:0:14387:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599492.804079:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787599492.804087:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787599492.814936:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787599492.814953:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787599492.819236:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787599492.819262:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787599492.824872:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787599492.824908:0:14387:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.130@tcp' 00000020:01000004:0.0:1787599492.824910:0:14387:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787599492.824950:0:14387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.130@tcp (typ=mgc) 00000020:00000080:0.0:1787599492.824981:0:14387:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.130@tcp (ffff9f6c767099b8) 00000020:00000080:0.0:1787599492.825005:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787599492.825106:0:14387:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f6b45120000@MGC192.168.204.130@tcp: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1787599492.825358:0:14387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.130@tcp-0 is initialized 00000040:01000000:0.0:1787599492.825367:0:14387:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787599492.825852:0:14401:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787599492.829062:0:14402:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787599492.829246:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.130@tcp (uuid 2ecb12f6-efb3-4b22-8787-68be26cc19d4) 00000020:00000080:2.0:1787599492.829279:0:14387:0:(genops.c:1385:class_connect()) connect: client 2ecb12f6-efb3-4b22-8787-68be26cc19d4, cookie 0xa46cbc67411835b2 00000100:00080000:2.0:1787599492.829295:0:14387:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599492.829302:0:14387:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff9f6b45120000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787599492.829350:0:14387:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c466eed80 x1874433543329408/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599492.829386:0:14387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2ecb12f6-efb3-4b22-8787-68be26cc19d4->MGS 00000020:01000004:2.0:1787599492.829415:0:14387:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:0.0:1787599492.829550:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3298:1874433543329408:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787599492.829654:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599492.829749:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543329408 00000100:00100000:0.0:1787599492.829760:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543329408 00000100:00100000:0.0:1787599492.829806:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599492.829815:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6a294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3298:x1874433543329408:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787599492.829843:0:14398:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2ecb12f6-efb3-4b22-8787-68be26cc19d4@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1787599492.829876:0:14398:0:(genops.c:1385:class_connect()) connect: client 2ecb12f6-efb3-4b22-8787-68be26cc19d4, cookie 0xa46cbc67411835b9 00000100:00080000:0.0:1787599492.830048:0:14398:0:(import.c:65:import_set_state_nolock()) ffff9f6c75f2f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599492.830117:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6a294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+5:3298:x1874433543329408:12345-0@lo:250:mount.lustre.0 Request processed in 300us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599492.830125:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599492.830225:0:3298:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787599492.830237:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1787599492.830245:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787599492.830250:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787599492.830255:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6b45120000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787599492.830258:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787599492.830267:0:3298:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787599492.830273:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3298:1874433543329408:0@lo:250:mount.lustre.0 00000020:01000004:2.0:1787599492.830921:0:14387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787599492.830945:0:14387:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f6b44a719b8) 00000020:00000080:2.0:1787599492.831024:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787599492.879470:0:14387:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599492.879741:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787599492.879749:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787599492.882637:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599492.882653:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787599492.884471:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787599492.884489:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787599492.906070:0:14387:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599492.906497:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787599492.906506:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787599492.907065:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787599492.907073:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787599492.966474:0:14387:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599492.966715:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787599492.966723:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787599492.968809:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787599492.968832:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787599492.969790:0:14387:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599492.969981:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787599492.969986:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787599492.971030:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787599492.971037:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787599492.971793:0:14387:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599492.972056:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787599492.972061:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787599492.972806:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787599492.972848:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787599492.973550:0:14387:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599492.973711:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787599492.973717:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787599492.974547:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787599492.974555:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787599492.994501:0:14387:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599492.994740:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787599492.994747:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787599492.997550:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599492.997562:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787599492.998567:0:14387:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787599492.998575:0:14387:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787599492.999453:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787599492.999477:0:14387:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787599492.999484:0:14387:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787599492.999620:0:14387:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787599492.999657:0:14387:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787599492.999661:0:14387:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787599492.999663:0:14387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599492.999665:0:14387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599492.999666:0:14387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599492.999667:0:14387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599492.999668:0:14387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599492.999670:0:14387:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599492.999672:0:14387:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599492.999673:0:14387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599492.999675:0:14387:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787599492.999677:0:14387:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787599492.999679:0:14387:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599492.999683:0:14387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599492.999684:0:14387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599492.999685:0:14387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599492.999686:0:14387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599492.999687:0:14387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599492.999688:0:14387:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599492.999689:0:14387:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599492.999690:0:14387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599492.999691:0:14387:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787599492.999719:0:14387:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787599492.999735:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543329536:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787599492.999921:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.000012:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855840 going to sleep for 11 seconds 00000100:00100000:2.0:1787599493.000131:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543329536 00000100:00100000:2.0:1787599493.000140:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543329536 00000100:00100000:2.0:1787599493.000307:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599493.000330:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6a295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+5:14387:x1874433543329536:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787599493.000385:0:14400:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787599493.000388:0:14400:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787599493.000392:0:14400:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787599493.000740:0:14421:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787599493.001139:0:14400:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787599493.004482:0:14422:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787599493.004492:0:14422:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787599493.004495:0:14422:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787599493.004532:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787599493.006765:0:14400:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787599493.006777:0:14400:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787599493.018070:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6a295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+5:14387:x1874433543329536:12345-0@lo:253:mount.lustre.0 Request processed in 17730us (18243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.018093:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599493.019680:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543329536:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787599493.019699:0:14387:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787599493.019703:0:14387:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787599493.019704:0:14387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599493.019705:0:14387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599493.019707:0:14387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599493.019708:0:14387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599493.019709:0:14387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599493.019710:0:14387:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599493.019712:0:14387:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599493.019714:0:14387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599493.019716:0:14387:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787599493.019739:0:14387:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f6b45127800 from lustre-MDT0000 10000000:01000000:0.0:1787599493.019768:0:14387:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787599493.019771:0:14387:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787599493.019775:0:14387:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f6c767099b8 10000000:01000000:0.0:1787599493.019786:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599493.019795:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f6c767099b8 from 1 10000000:01000000:0.0:1787599493.019808:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787599493.019851:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.019863:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.019874:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599493.019895:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543329664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599493.019949:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.020483:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599493.022726:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543329664 00000100:00100000:1.0:1787599493.022740:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543329664 00000100:00100000:1.0:1787599493.022811:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599493.022823:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6a295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+5:14387:x1874433543329664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599493.022840:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599493.022864:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75ddea00/0xa46cbc67411835ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411835c7 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.022894:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75ddea00/0xa46cbc67411835ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411835c7 expref: 6 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.022905:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75ddea00/0xa46cbc67411835ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411835c7 expref: 6 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.022914:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75ddea00, rc 0) 00000100:00100000:1.0:1787599493.023048:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6a295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+6:14387:x1874433543329664:12345-0@lo:101:mount.lustre.0 Request processed in 226us (3097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.023055:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599493.025765:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543329664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599493.025796:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ce expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.025809:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411835ce expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599493.025892:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543329792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599493.025955:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.026001:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599493.027594:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543329792 00000100:00100000:1.0:1787599493.027607:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543329792 00000100:00100000:1.0:1787599493.027676:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599493.027687:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6a296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+6:14387:x1874433543329792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599493.027997:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6a296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+6:14387:x1874433543329792:12345-0@lo:501:mount.lustre.0 Request processed in 311us (2041us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599493.028005:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599493.028140:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543329792:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787599493.028205:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787599493.028225:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ce expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.028248:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ce expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599493.028257:0:14387:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f6b45127800 10000000:01000000:0.0:1787599493.028262:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787599493.028266:0:14387:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f6b45127800 10000000:01000000:0.0:1787599493.028269:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787599493.028272:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f6b45127800 from 1 10000000:01000000:0.0:1787599493.028274:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787599493.028306:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411835d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.028313:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411835d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.028321:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411835d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599493.028340:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543329920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599493.028380:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.028419:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599493.028532:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543329920 00000100:00100000:3.0:1787599493.028537:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543329920 00000100:00100000:3.0:1787599493.028577:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599493.028586:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+6:14387:x1874433543329920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599493.028598:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599493.028621:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c76066e00/0xa46cbc67411835dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411835d5 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.028643:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c76066e00/0xa46cbc67411835dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411835d5 expref: 7 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.028654:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c76066e00/0xa46cbc67411835dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411835d5 expref: 7 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.028662:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c76066e00, rc 0) 00000100:00100000:3.0:1787599493.028704:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+7:14387:x1874433543329920:12345-0@lo:101:mount.lustre.0 Request processed in 119us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599493.028710:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599493.028933:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543329920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599493.028946:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411835d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835dc expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.028956:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411835d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411835dc expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599493.028991:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787599493.029007:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411835d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835dc expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.029014:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff000/0xa46cbc67411835d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835dc expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599493.029021:0:14387:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787599493.029024:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599493.029029:0:14387:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f6b45127800 10000000:01000000:0.0:1787599493.029032:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787599493.029035:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787599493.029038:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787599493.029058:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff800/0xa46cbc67411835e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.029065:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff800/0xa46cbc67411835e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.029072:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff800/0xa46cbc67411835e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599493.029086:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543330048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599493.029115:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.029140:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599493.029237:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543330048 00000100:00100000:3.0:1787599493.029242:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543330048 00000100:00100000:3.0:1787599493.029286:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599493.029294:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+7:14387:x1874433543330048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599493.029303:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599493.029314:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c76067400/0xa46cbc67411835ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411835e3 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.029329:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c76067400/0xa46cbc67411835ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411835e3 expref: 8 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.029339:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c76067400/0xa46cbc67411835ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411835e3 expref: 8 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.029346:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c76067400, rc 0) 00000100:00100000:3.0:1787599493.029387:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+8:14387:x1874433543330048:12345-0@lo:101:mount.lustre.0 Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599493.029403:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599493.029638:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543330048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599493.029651:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff800/0xa46cbc67411835e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ea expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.029667:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff800/0xa46cbc67411835e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411835ea expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599493.029716:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543330176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599493.030010:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.030098:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599493.030324:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543330176 00000100:00100000:3.0:1787599493.030330:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543330176 00000100:00100000:3.0:1787599493.030397:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599493.030407:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+8:14387:x1874433543330176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599493.031022:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+9:14387:x1874433543330176:12345-0@lo:501:mount.lustre.0 Request processed in 615us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599493.031031:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599493.031389:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543330176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599493.031422:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543330304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599493.031456:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.031492:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c75855b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599493.031507:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543330304 00000100:00100000:3.0:1787599493.031512:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543330304 00000100:00100000:3.0:1787599493.031546:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599493.031554:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+9:14387:x1874433543330304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599493.032323:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543330304:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599493.032396:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+9:14387:x1874433543330304:12345-0@lo:503:mount.lustre.0 Request processed in 570us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599493.032407:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599493.036543:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14423:1874433543330432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599493.036634:0:14423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599493.036738:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7502b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599493.037002:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543330432 00000100:00100000:1.0:1787599493.037012:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543330432 00000100:00100000:1.0:1787599493.037066:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599493.037078:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+9:14423:x1874433543330432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599493.037603:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+9:14423:x1874433543330432:12345-0@lo:502:llog_process_th.0 Request processed in 526us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.037612:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787599493.037888:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14423:1874433543330432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599493.037923:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599493.037936:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599493.037938:0:14423:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787599493.037943:0:14423:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787599493.037946:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599493.037961:0:14423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f6c48333370) 00000020:00000080:3.0:1787599493.037978:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787599493.037990:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787599493.038070:0:14423:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787599493.038077:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc67411835f8 00000020:00000080:3.0:1787599493.038373:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787599493.038377:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599493.038380:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599493.038382:0:14423:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787599493.038384:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599493.038388:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599493.038389:0:14423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787599493.038392:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599493.038399:0:14423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f6c48330000) 00000020:00000080:3.0:1787599493.038408:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787599493.038411:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787599493.038412:0:14423:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787599493.038415:0:14423:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787599493.038420:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787599493.039407:0:14423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6b45127800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787599493.039425:0:14423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f6c48334d28) 00000020:00000080:3.0:1787599493.039437:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787599493.039617:0:14423:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787599493.039626:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa46cbc674118360d 00000020:00000080:3.0:1787599493.039739:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787599493.039747:0:14423:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787599493.039756:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa46cbc6741183614 00080000:01000000:3.0:1787599493.039762:0:14423:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787599493.039769:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc674118361b 00010000:00010000:2.0:1787599493.091136:0:14423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787599493.091735:0:14423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787599493.091925:0:14423:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787599493.092712:0:14423:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f6b44a73370) 00000020:00000080:2.0:1787599493.092734:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787599493.092803:0:14423:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787599493.092810:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc6741183629 00000020:00000080:2.0:1787599493.093369:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787599493.097550:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa46cbc6741183630 00000020:00000080:2.0:1787599493.098431:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787599493.098448:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599493.098455:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599493.098458:0:14423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787599493.098462:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787599493.098465:0:14423:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787599493.098467:0:14423:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599493.098469:0:14423:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599493.098471:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787599493.098473:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599493.098475:0:14423:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787599493.098486:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599493.098491:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599493.098492:0:14423:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787599493.098497:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787599493.098536:0:14423:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787599493.098549:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599493.098553:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599493.098554:0:14423:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787599493.098557:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787599493.098560:0:14423:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787599493.098564:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599493.098565:0:14423:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787599493.098568:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787599493.098573:0:14423:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:2.0:1787599493.098600:0:14423:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787599493.098603:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599493.098618:0:14423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f6c50f78000) 00000020:00000080:2.0:1787599493.098633:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787599493.098639:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787599493.099486:0:14423:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787599493.099496:0:14423:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787599493.099506:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc674118363e 00010000:00080000:2.0:1787599493.099546:0:14423:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f6c580a8800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1787599493.099823:0:14423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787599493.100434:0:14423:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787599493.100491:0:14423:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787599493.101664:0:14423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599493.101721:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787599493.101816:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787599493.102394:0:14427:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787599493.102399:0:14427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787599493.103650:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599493.103669:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787599493.103706:0:14423:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787599493.103908:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa46cbc6741183645 00000100:00080000:1.0:1787599493.103918:0:14423:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599493.103922:0:14423:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f6c580a8800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1787599493.103967:0:14423:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c76123100 x1874433543330560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599493.103991:0:14423:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787599493.104050:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599493.104054:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599493.104056:0:14423:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787599493.104059:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787599493.104062:0:14423:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1787599493.104064:0:14423:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599493.104065:0:14423:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787599493.104067:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787599493.104069:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599493.104070:0:14423:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787599493.104073:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599493.104077:0:14423:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787599493.104081:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599493.104083:0:14423:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787599493.104086:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787599493.104090:0:14423:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000100:00100000:0.0:1787599493.104113:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543330560:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1787599493.104119:0:14423:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787599493.104123:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000400:00000100:0.0:1787599493.104226:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433543330560 offset 0 length 520: 4 00000020:00000080:1.0:1787599493.104268:0:14423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f6c7f7b8000) 00000020:00000080:1.0:1787599493.104284:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787599493.104290:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787599493.104354:0:14423:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787599493.104360:0:14423:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787599493.104368:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa46cbc6741183653 00010000:00080000:1.0:1787599493.104397:0:14423:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f6c7662b000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1787599493.104616:0:14423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787599493.104903:0:14423:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787599493.104929:0:14423:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787599493.105620:0:14423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599493.106912:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787599493.107032:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787599493.109007:0:14429:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787599493.109015:0:14429:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787599493.110481:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599493.110501:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787599493.110536:0:14423:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787599493.110560:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa46cbc674118365a 00000100:00080000:1.0:1787599493.110573:0:14423:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599493.110581:0:14423:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f6c7662b000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1787599493.110653:0:14423:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c76122a00 x1874433543330688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599493.110722:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543330688:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787599493.110872:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433543330688 offset 0 length 520: 4 00000100:00080000:1.0:1787599493.110942:0:14423:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787599493.111007:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599493.111012:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599493.111015:0:14423:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787599493.111018:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599493.111023:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599493.111024:0:14423:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787599493.111028:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787599493.111030:0:14423:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787599493.111032:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599493.111043:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599493.111044:0:14423:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787599493.111047:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599493.111050:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599493.111051:0:14423:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787599493.111055:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787599493.111086:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14423:1874433543330816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599493.111140:0:14423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599493.111353:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543330816 00000100:00100000:1.0:1787599493.111374:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543330816 00000100:00100000:1.0:1787599493.111420:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599493.111429:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+9:14423:x1874433543330816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599493.111685:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+9:14423:x1874433543330816:12345-0@lo:502:llog_process_th.0 Request processed in 256us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.111694:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599493.111939:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70877c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599493.111961:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14423:1874433543330816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787599493.111990:0:14423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599493.111995:0:14423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599493.111996:0:14423:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787599493.112000:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787599493.114845:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787599493.114884:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787599493.114913:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff800/0xa46cbc67411835e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ea expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.114926:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751ff800/0xa46cbc67411835e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ea expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599493.114936:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f6b45127800 from 1 10000000:01000000:0.0:1787599493.114953:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787599493.114997:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.115006:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.115016:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599493.115039:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543330944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599493.115108:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.115150:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c758550c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599493.115193:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543330944 00000100:00100000:1.0:1787599493.115202:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543330944 00000100:00100000:1.0:1787599493.115257:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599493.115268:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+9:14387:x1874433543330944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599493.115282:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599493.115297:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75dde600/0xa46cbc6741183668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741183661 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.115337:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75dde600/0xa46cbc6741183668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741183661 expref: 10 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.115541:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75dde600/0xa46cbc6741183668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741183661 expref: 10 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.115551:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75dde600, rc 0) 00000100:00100000:1.0:1787599493.115613:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+10:14387:x1874433543330944:12345-0@lo:101:mount.lustre.0 Request processed in 346us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.115620:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599493.115672:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543330944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599493.115688:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.115698:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599493.116720:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331072:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787599493.117391:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.117435:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c758550c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599493.117500:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543331072 00000100:00100000:1.0:1787599493.117509:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543331072 00000100:00100000:1.0:1787599493.117551:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787599493.117561:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+10:14387:x1874433543331072:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787599493.117582:0:14399:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787599493.117588:0:14399:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787599493.118437:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+10:14387:x1874433543331072:12345-0@lo:256:mount.lustre.0 Request processed in 871us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.118449:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599493.118571:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331072:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787599493.119742:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787599493.119867:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.119907:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599493.120107:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6b45127800 from 1 10000000:01000000:1.0:1787599493.120111:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787599493.120526:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.120537:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.120549:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599493.120584:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787599493.120738:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599493.120859:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70877900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599493.121247:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543331200 00000100:00100000:3.0:1787599493.121257:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543331200 00000100:00100000:3.0:1787599493.121316:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599493.121328:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+10:14387:x1874433543331200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599493.121355:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599493.121372:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c76066200/0xa46cbc6741183676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118366f expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.121402:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c76066200/0xa46cbc6741183676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118366f expref: 11 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.121413:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c76066200/0xa46cbc6741183676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118366f expref: 11 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.121422:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c76066200, rc 0) 00000100:00100000:3.0:1787599493.121474:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14387:x1874433543331200:12345-0@lo:101:mount.lustre.0 Request processed in 149us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599493.121480:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787599493.121524:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599493.121540:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.121549:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599493.121606:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599493.121726:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599493.121878:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c70877900 going to sleep for 11 seconds 00000100:00100000:0.0:1787599493.130051:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543331328 00000100:00100000:0.0:1787599493.130067:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543331328 00000100:00100000:2.0:1787599493.132514:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599493.132529:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14387:x1874433543331328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599493.133141:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14387:x1874433543331328:12345-0@lo:501:mount.lustre.0 Request processed in 614us (11412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599493.133248:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599493.133279:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599493.133335:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599493.133387:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.133435:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c758550c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599493.133482:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543331456 00000100:00100000:1.0:1787599493.133490:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543331456 00000100:00100000:1.0:1787599493.133535:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599493.133545:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14387:x1874433543331456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599493.133722:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14387:x1874433543331456:12345-0@lo:503:mount.lustre.0 Request processed in 178us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.133729:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599493.133880:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599493.134508:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14431:1874433543331584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599493.134557:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599493.134627:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c51842900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599493.134668:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543331584 00000100:00100000:2.0:1787599493.134675:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543331584 00000100:00100000:2.0:1787599493.134741:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599493.134750:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14431:x1874433543331584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599493.135070:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14431:x1874433543331584:12345-0@lo:502:llog_process_th.0 Request processed in 321us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599493.135078:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599493.135201:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14431:1874433543331584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599493.135227:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599493.135238:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599493.135240:0:14431:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787599493.135248:0:14431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6b45127800 00000020:00000080:3.0:1787599493.135251:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599493.135259:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599493.135261:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599493.135263:0:14431:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787599493.135265:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599493.135268:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599493.135269:0:14431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787599493.135282:0:14431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6b45127800 00000020:00000080:3.0:1787599493.135284:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599493.135339:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599493.135343:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599493.135344:0:14431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787599493.135347:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599493.135349:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599493.135350:0:14431:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787599493.135354:0:14431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f6b45127800 00000020:00000080:3.0:1787599493.135356:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787599493.135393:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14431:1874433543331712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599493.135429:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599493.142585:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c51841600 going to sleep for 11 seconds 00000100:00100000:1.0:1787599493.143010:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543331712 00000100:00100000:1.0:1787599493.143021:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543331712 00000100:00100000:1.0:1787599493.143190:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599493.143203:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14431:x1874433543331712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599493.143457:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14431:x1874433543331712:12345-0@lo:502:llog_process_th.0 Request processed in 256us (8025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.143470:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787599493.143476:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14431:1874433543331712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599493.143518:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599493.143530:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599493.143533:0:14431:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787599493.143537:0:14431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787599493.144260:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787599493.144286:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787599493.144305:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599493.144317:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599493.144361:0:14387:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787599493.144365:0:14387:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f6b45127800 10000000:01000000:2.0:1787599493.144368:0:14387:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f6b45127800 10000000:01000000:2.0:1787599493.144372:0:14387:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599493.144378:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6b45127800 from 1 10000000:01000000:2.0:1787599493.144380:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787599493.144527:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc674118367d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599493.144536:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc674118367d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599493.144547:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc674118367d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599493.144569:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599493.144615:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599493.144683:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c452bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599493.144738:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543331840 00000100:00100000:0.0:1787599493.144745:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543331840 00000100:00100000:0.0:1787599493.144775:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787599493.144784:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14387:x1874433543331840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599493.144796:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599493.144810:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751fe200/0xa46cbc6741183684 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118367d expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.144832:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fe200/0xa46cbc6741183684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118367d expref: 12 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.144841:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751fe200/0xa46cbc6741183684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118367d expref: 12 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.144850:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe200, rc 0) 00000100:00100000:0.0:1787599493.144993:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14387:x1874433543331840:12345-0@lo:101:mount.lustre.0 Request processed in 210us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599493.145000:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787599493.145074:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599493.145089:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc674118367d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183684 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599493.145099:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc674118367d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741183684 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599493.145326:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599493.145360:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599493.145384:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c452bb180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599493.145401:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543331968 00000100:00100000:2.0:1787599493.145404:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543331968 00000100:00100000:2.0:1787599493.145451:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599493.145460:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14387:x1874433543331968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599493.145695:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14387:x1874433543331968:12345-0@lo:501:mount.lustre.0 Request processed in 236us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599493.145712:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599493.145753:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543331968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599493.145786:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543332096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599493.145825:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599493.145840:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c452bb180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599493.145854:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543332096 00000100:00100000:2.0:1787599493.145858:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543332096 00000100:00100000:2.0:1787599493.145882:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599493.145889:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14387:x1874433543332096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599493.146119:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14387:x1874433543332096:12345-0@lo:503:mount.lustre.0 Request processed in 229us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599493.146127:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599493.146276:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543332096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599493.146502:0:14435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14435:1874433543332224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599493.146546:0:14435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599493.146567:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543332224 00000100:00100000:2.0:1787599493.146571:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543332224 00000100:00100000:2.0:1787599493.146599:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599493.146606:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14435:x1874433543332224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599493.146781:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14435:x1874433543332224:12345-0@lo:502:llog_process_th.0 Request processed in 174us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599493.146788:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599493.146832:0:14435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c452bb000 going to sleep for 11 seconds 00000100:00100000:2.0:1787599493.146844:0:14435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14435:1874433543332224:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787599493.147057:0:14435:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787599493.147073:0:14435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f6c50f799b8) 00000020:00000080:2.0:1787599493.147092:0:14435:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787599493.147274:0:14435:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6b45127800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787599493.147279:0:14435:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f6b45127800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787599493.147281:0:14435:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6b45127800 4 00010000:00080000:2.0:1787599493.147309:0:14435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f6c50e43000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1787599493.149359:0:14435:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787599493.149640:0:14435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787599493.149675:0:14435:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787599493.149686:0:14435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa46cbc6741183692 00000100:00080000:2.0:1787599493.149696:0:14435:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599493.149701:0:14435:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f6c50e43000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787599493.149732:0:14435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c466eea00 x1874433543332352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599493.149766:0:14435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787599493.151545:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874433543332352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787599493.151624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599493.151699:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543332352 00000100:00100000:1.0:1787599493.151707:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543332352 00000100:00100000:1.0:1787599493.151738:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599493.151746:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874433543332352:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787599493.151799:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874433543332352:12345-0@lo:38:llog_process_th.0 Request processed in 52us (175us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787599493.151806:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599493.151842:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599493.151851:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c50e43000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599493.151855:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787599493.151858:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874433543332352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787599493.152583:0:14435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14435:1874433543332480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599493.152632:0:14435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599493.152649:0:14435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c504a6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787599493.152668:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543332480 00000100:00100000:2.0:1787599493.152671:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543332480 00000100:00100000:2.0:1787599493.152700:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787599493.152707:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14435:x1874433543332480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599493.153108:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14435:x1874433543332480:12345-0@lo:502:llog_process_th.0 Request processed in 400us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599493.153117:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787599493.153279:0:14435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14435:1874433543332480:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787599493.153315:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787599493.153496:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787599493.153517:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599493.153532:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc674118367d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183684 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599493.153543:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40031c00/0xa46cbc674118367d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183684 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787599493.153586:0:14387:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787599493.153588:0:14387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787599493.153590:0:14387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599493.153591:0:14387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599493.153592:0:14387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599493.153593:0:14387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599493.153595:0:14387:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787599493.153596:0:14387:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787599493.153598:0:14387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599493.153600:0:14387:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787599493.153604:0:14387:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787599493.153607:0:14387:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787599493.153608:0:14387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787599493.153609:0:14387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599493.153611:0:14387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599493.153612:0:14387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599493.153613:0:14387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599493.153614:0:14387:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787599493.153615:0:14387:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787599493.153615:0:14387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599493.153616:0:14387:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787599493.153630:0:14387:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787599493.153641:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543332608:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787599493.153679:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599493.153709:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c504a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599493.154628:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543332608 00000100:00100000:1.0:1787599493.154636:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543332608 00000100:00100000:1.0:1787599493.154691:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599493.154704:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14387:x1874433543332608:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787599493.154731:0:14400:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787599493.154745:0:14400:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787599493.189206:0:14400:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787599493.189217:0:14400:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787599493.189332:0:14421:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787599493.189337:0:14421:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787599493.189366:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.189385:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c75dde600/0xa46cbc6741183668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741183661 expref: 12 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.189393:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.189434:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c75dde600/0xa46cbc6741183668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741183661 expref: 12 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.189449:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c75dde600/0xa46cbc6741183668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741183661 expref: 12 pid: 14398 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599493.189464:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14421:1874433543332736:0@lo:104: 00000100:00100000:0.0:1787599493.189532:0:14421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599493.189582:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599493.189808:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543332736 00000100:00100000:1.0:1787599493.189817:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543332736 00000100:00100000:1.0:1787599493.189865:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599493.189874:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+3:14421:x1874433543332736:12345-0@lo:104: 00010000:00010000:1.0:1787599493.189895:0:14388:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.189971:0:14388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599493.189979:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+3:14421:x1874433543332736:12345-0@lo:104: Request processed in 106us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.189987:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787599493.190013:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599493.190020:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190029:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ffa00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599493.190034:0:14394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190044:0:14394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599493.190053:0:14394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599493.190060:0:14394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599493.190093:0:14394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190101:0:14394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599493.190124:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190131:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffa00/0xa46cbc6741183661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183668 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190200:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599493.190204:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599493.190206:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599493.190235:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543332864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599493.190264:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599493.190330:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543332864 00000100:00100000:1.0:1787599493.190334:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543332864 00010000:00010000:1.0:1787599493.190356:0:14390:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c75dde600/0xa46cbc6741183668 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741183661 expref: 13 pid: 14398 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599493.190387:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599493.190395:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+13:3302:x1874433543332864:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599493.190402:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14421:1874433543332736:0@lo:104: 00010000:00010000:1.0:1787599493.190406:0:14390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599493.190414:0:14390:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c75dde600/0xa46cbc6741183668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741183661 expref: 13 pid: 14398 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190426:0:14390:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c75dde600/0xa46cbc6741183668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741183661 expref: 13 pid: 14398 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190440:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75dde600/0xa46cbc6741183668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741183661 expref: 13 pid: 14398 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190455:0:14390:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190463:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787599493.190475:0:14390:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001138848s 00010000:00010000:1.0:1787599493.190486:0:14390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190494:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.190496:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190511:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.190525:0:14421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599493.190533:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190823:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190831:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751fee00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599493.190836:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190844:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190854:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190862:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751fee00/0xa46cbc6741183699 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.190875:0:14390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599493.190954:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:3302:x1874433543332864:12345-0@lo:103:ldlm_bl.0 Request processed in 560us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599493.190962:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599493.191049:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543332864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599493.206261:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14387:x1874433543332608:12345-0@lo:253:mount.lustre.0 Request processed in 51550us (52571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599493.206277:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787599493.206740:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14387:1874433543332608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787599493.206768:0:14387:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787599493.206771:0:14387:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787599493.206773:0:14387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599493.206774:0:14387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599493.206776:0:14387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599493.206777:0:14387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599493.206778:0:14387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599493.206780:0:14387:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599493.206781:0:14387:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599493.206783:0:14387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599493.206785:0:14387:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787599493.206808:0:14387:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787599493.214705:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787599493.215024:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787599493.215431:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787599493.215793:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787599493.216430:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787599493.216789:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787599493.217655:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787599493.217954:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787599493.218401:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787599493.218660:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787599493.219472:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787599493.219664:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787599493.270847:0:14387:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000020:00080000:2.0:1787599493.275396:0:14443:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787599493.275403:0:14443:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787599493.275508:0:14387:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787599493.275889:0:14444:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787599493.276000:0:14444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787599493.278558:0:14387:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787599493.278690:0:14387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787599493.279107:0:14387:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787599493.279116:0:14387:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787599493.286845:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787599493.286935:0:14444:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787599493.286940:0:14444:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1787599493.289610:0:14387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599493.290638:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787599493.291145:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787599493.291223:0:14387:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787599493.297138:0:14387:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787599493.312844:0:14387:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787599493.382787:0:14387:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787599493.382822:0:14387:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc2c381c93988 00100000:10000000:0.0:1787599493.382829:0:14387:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787599493.383071:0:14387:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787599493.383086:0:14387:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787599493.383099:0:14387:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787599493.383126:0:14387:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787599493.794949:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787599493.986484:0:14402:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787599493.986493:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f6b45127800 from 6 10000000:01000000:1.0:1787599493.986497:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787599493.986813:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.986826:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.986839:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599493.986864:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543332992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599493.986936:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599493.987000:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c50f739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599493.987067:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543332992 00000100:00100000:3.0:1787599493.987076:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543332992 00000100:00100000:3.0:1787599493.987134:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787599493.987144:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14402:x1874433543332992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599493.987182:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599493.987196:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c76067800/0xa46cbc67411836a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411836a0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.987227:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c76067800/0xa46cbc67411836a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411836a0 expref: 12 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.987237:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c76067800/0xa46cbc67411836a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411836a0 expref: 12 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599493.987246:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c76067800, rc 0) 00000100:00100000:3.0:1787599493.987284:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14402:x1874433543332992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599493.987290:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599493.987451:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543332992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599493.987464:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.987473:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599493.987524:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543333120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787599493.987875:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599493.987907:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c50f739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599493.987957:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543333120 00000100:00100000:3.0:1787599493.987961:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543333120 00000100:00100000:3.0:1787599493.987997:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787599493.988014:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14402:x1874433543333120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787599493.988028:0:14400:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787599493.988042:0:14400:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787599493.988045:0:14400:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787599493.988118:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14402:x1874433543333120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599493.988125:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787599493.988389:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543333120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787599493.988499:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787599493.988507:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599493.988516:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599494.182295:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787599494.818003:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599495.201863:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787599495.848137:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599496.875643:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599497.891403:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787599498.278288:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599498.278296:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599498.278299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599498.278302:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599498.278306:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787599498.278309:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787599498.278321:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f6c50e43000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599498.278348:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f6c50e43000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787599498.278372:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3299:1874433543333248:0@lo:400:kworker.0 00000100:00100000:3.0:1787599498.278374:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c7609d180 x1874433543333376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599498.278509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599498.278643:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874433543333376:0@lo:38:kworker.0 00000100:00100000:3.0:1787599498.281911:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543333248 00000100:00100000:3.0:1787599498.282287:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543333248 00000100:00100000:3.0:1787599498.282368:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599498.282380:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:3299:x1874433543333248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599498.282658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599498.282764:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:3299:x1874433543333248:12345-0@lo:400:kworker.0 Request processed in 385us (4254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599498.282786:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599498.282955:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3299:1874433543333248:0@lo:400:kworker.0 00000100:00100000:1.0:1787599498.283028:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543333376 00000100:00100000:1.0:1787599498.283033:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543333376 00000100:00100000:1.0:1787599498.284861:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599498.284892:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1874433543333376:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787599498.284958:0:14407:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:1.0:1787599498.285028:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa46cbc67411836ae 00000004:00100000:1.0:1787599498.285087:0:14407:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787599498.285353:0:14407:0:(import.c:65:import_set_state_nolock()) ffff9f6c50990000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599498.285862:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874433543333376:12345-0@lo:38:kworker.0 Request processed in 968us (3202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599498.285872:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787599498.286020:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f6c7609d180 x1874433543333376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787599498.286039:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787599498.286059:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787599498.286064:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787599498.286067:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c50e43000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787599498.286084:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874433543333376:0@lo:38:kworker.0 00000001:02000400:0.0:1787599498.648795:0:14687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787599498.918287:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599499.937443:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599500.962532:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599501.988455:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787599502.023505:0:14838:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd3b79620 20000000:00000080:2.0:1787599502.023524:0:14838:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f6c70e8b400 uarg=0000000000000000 20000000:01000000:2.0:1787599502.023559:0:14838:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787599502.023566:0:14838:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787599502.023572:0:14838:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787599502.030532:0:14839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787599502.035132:0:14838:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787599502.044606:0:14838:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787599502.046242:0:14838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599502.046270:0:14838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c76066200/0xa46cbc6741183676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118366f expref: 11 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599502.046392:0:14838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599502.046453:0:14838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c76066200/0xa46cbc6741183676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc674118366f expref: 11 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599502.046472:0:14838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c76066200/0xa46cbc6741183676 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc674118366f expref: 11 pid: 14398 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599502.046490:0:14838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14838:1874433543333504:0@lo:104: 00000100:00100000:3.0:1787599502.046579:0:14838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599502.046750:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543333504 00000100:00100000:2.0:1787599502.046761:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543333504 00000100:00100000:3.0:1787599502.046827:0:14838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599502.050486:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599502.050519:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+3:14838:x1874433543333504:12345-0@lo:104: 00010000:00010000:1.0:1787599502.050544:0:14388:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599502.050695:0:14388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599502.050701:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+3:14838:x1874433543333504:12345-0@lo:104: Request processed in 201us (4124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599502.050708:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787599502.050798:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599502.050806:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.050815:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75dde800 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:0.0:1787599502.050819:0:14394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.050829:0:14394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599502.050860:0:14394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599502.050866:0:14394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787599502.050928:0:14394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.050936:0:14394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599502.050965:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.050973:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde800/0xa46cbc674118366f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183676 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.050996:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599502.050998:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599502.051011:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599502.051030:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3300:1874433543333632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599502.051082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599502.051199:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543333632 00000100:00100000:0.0:1787599502.051209:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543333632 00010000:00010000:0.0:1787599502.051238:0:14391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c76066200/0xa46cbc6741183676 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118366f expref: 12 pid: 14398 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599502.051260:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599502.051267:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:3300:x1874433543333632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599502.051293:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599502.051300:0:14391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c76066200/0xa46cbc6741183676 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118366f expref: 12 pid: 14398 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051318:0:14391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c76066200/0xa46cbc6741183676 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc674118366f expref: 12 pid: 14398 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051340:0:14391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051349:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051368:0:14391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051386:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051394:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051400:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051406:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:0.0:1787599502.051411:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051420:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051429:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599502.051452:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599502.051490:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:3300:x1874433543333632:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599502.051497:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599502.051538:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3300:1874433543333632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599502.052070:0:14838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c76066200/0xa46cbc6741183676 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc674118366f expref: 11 pid: 14398 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599502.052097:0:14838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14838:1874433543333504:0@lo:104: 00010000:00010000:3.0:1787599502.052117:0:14838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599502.052126:0:14838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599502.052133:0:14838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599502.052139:0:14838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c76067600/0xa46cbc67411836b5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599503.009530:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599503.393316:0:3298:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599493/real 1787599493] req@ffff9f6c76122a00 x1874433543330688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599503 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599503.393370:0:3298:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f6c76122a00 x1874433543330688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599503 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599503.393383:0:3298:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599493/real 1787599493] req@ffff9f6c76123100 x1874433543330560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599503 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599503.393398:0:3298:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f6c76123100 x1874433543330560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599503 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599503.393420:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599503.393445:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599503.393450:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543330688:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787599503.393457:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c580a8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599503.393462:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599503.393465:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543330560:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787599503.393805:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599503.393810:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787599503.393814:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f6c580a8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599503.393820:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1787599503.393827:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787599503.393836:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f6c580a8800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787599503.393863:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c466eea00 x1874433543333888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599503.393877:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599503.393880:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787599503.393882:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599503.393885:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1787599503.393888:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787599503.393891:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f6c7662b000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787599503.393902:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c466eed80 x1874433543334016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599503.393948:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543334144:0@lo:400:kworker.0 00000100:00100000:2.0:1787599503.394068:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599503.394132:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599503.394139:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543333760:0@lo:400:kworker.0 00000100:00100000:2.0:1787599503.394201:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599503.398069:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543334144 00000100:00100000:1.0:1787599503.398092:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543334144 00000100:00100000:1.0:1787599503.398182:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599503.398198:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543334144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599503.398359:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874433543334144:12345-0@lo:400:kworker.0 Request processed in 165us (4290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599503.398367:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599503.398400:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543333760 00000100:00100000:1.0:1787599503.398405:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543333760 00000100:00100000:1.0:1787599503.398438:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599503.398446:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:3302:x1874433543333760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599503.398504:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:3302:x1874433543333760:12345-0@lo:400:kworker.0 Request processed in 59us (4302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599503.398511:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599503.398586:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543333888:0@lo:8:kworker.0 00000400:00000100:1.0:1787599503.398625:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433543333888 offset 0 length 520: 4 00000100:00100000:1.0:1787599503.398659:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543334016:0@lo:8:kworker.0 00000400:00000100:1.0:1787599503.398701:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433543334016 offset 0 length 520: 4 00000100:00100000:0.0:1787599503.401968:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543333760:0@lo:400:kworker.0 00010000:00080000:0.0:1787599503.402027:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f6c466edf80 x1874433543334144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599503.402043:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874433543334144:0@lo:400:kworker.0 10000000:01000000:3.0:1787599503.842525:0:14402:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599503.842534:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6b45127800 from 10 10000000:01000000:3.0:1787599503.842539:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599503.842593:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599503.842606:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599503.842618:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599503.842644:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543334272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599503.842722:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599503.842809:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599503.843318:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543334272 00000100:00100000:0.0:1787599503.843327:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543334272 00000100:00100000:0.0:1787599503.843387:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787599503.843397:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+11:14402:x1874433543334272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599503.843411:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599503.843427:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751ffe00/0xa46cbc67411836c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411836bc expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599503.843450:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ffe00/0xa46cbc67411836c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411836bc expref: 12 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599503.843461:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751ffe00/0xa46cbc67411836c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411836bc expref: 12 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599503.843471:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ffe00, rc 0) 00000100:00100000:0.0:1787599503.843537:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14402:x1874433543334272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599503.843556:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599503.844527:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543334272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599503.844560:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599503.844571:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599503.844655:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543334400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599503.844703:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599503.844755:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4fe98a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599503.845063:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543334400 00000100:00100000:0.0:1787599503.845069:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543334400 00000100:00100000:0.0:1787599503.845107:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787599503.845115:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14402:x1874433543334400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599503.845405:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14402:x1874433543334400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599503.845412:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787599503.845503:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543334400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599503.846647:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543334528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599503.846712:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599503.846745:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c514d8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599503.848369:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543334528 00000100:00100000:0.0:1787599503.848382:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543334528 00000100:00100000:0.0:1787599503.848460:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599503.848471:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14402:x1874433543334528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599503.848744:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:14402:x1874433543334528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599503.848751:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599503.848831:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543334528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787599503.852037:0:14900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787599503.852369:0:14402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787599503.852397:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599503.852411:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599503.852423:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599504.033342:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599505.057941:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599505.441855:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599506.091385:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599507.108613:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599508.130962:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787599508.513681:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599508.513687:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599508.513690:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599508.513693:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599508.513752:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543334784:0@lo:400:kworker.0 00000100:00100000:1.0:1787599508.513814:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599508.513871:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599508.513886:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3300:1874433543334656:0@lo:400:kworker.0 00000100:00100000:1.0:1787599508.513917:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599508.513961:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543334656 00000100:00100000:1.0:1787599508.513968:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543334656 00000100:00100000:1.0:1787599508.514007:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599508.514015:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:3300:x1874433543334656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599508.514064:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:3300:x1874433543334656:12345-0@lo:400:kworker.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599508.514070:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599508.514112:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3300:1874433543334656:0@lo:400:kworker.0 00000100:00100000:3.0:1787599508.514192:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543334784 00000100:00100000:3.0:1787599508.514197:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543334784 00000100:00100000:1.0:1787599508.514481:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599508.514490:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543334784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599508.514529:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543334784:12345-0@lo:400:kworker.0 Request processed in 41us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599508.514548:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787599508.514578:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f6c7609c380 x1874433543334784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599508.514590:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543334784:0@lo:400:kworker.0 00000020:01000004:2.0:1787599508.658466:0:15087:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787599508.658471:0:15087:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787599508.658600:0:15087:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f6c58ba7000 00000020:01000004:2.0:1787599508.658616:0:15087:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787599508.658627:0:15087:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787599508.658642:0:15087:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f6c50f7b370) 00000020:00000080:2.0:1787599508.658658:0:15087:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787599508.687019:0:15087:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787599508.687374:0:15087:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787599508.688139:0:15087:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787599508.688574:0:15087:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787599508.688783:0:15087:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787599508.689322:0:15087:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1787599508.689472:0:15087:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:0.0:1787599508.689614:0:15087:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:0.0:1787599508.690032:0:15087:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 427: rc = 0 00100000:10000000:0.0:1787599508.690476:0:15087:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 427: rc = 0 00100000:10000000:0.0:1787599508.690753:0:15087:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 427: rc = 0 00100000:10000000:0.0:1787599508.691012:0:15087:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 427: rc = 0 00100000:10000000:0.0:1787599508.691289:0:15087:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 427: rc = 0 00100000:10000000:0.0:1787599508.691532:0:15087:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 427: rc = 0 00000020:00000080:0.0:1787599508.692094:0:15087:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787599508.692108:0:15087:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787599508.692120:0:15087:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa46cbc67411836d1 00000020:01000004:0.0:1787599508.692128:0:15087:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787599508.692151:0:15087:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787599508.692258:0:15087:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787599508.692265:0:15087:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787599508.692270:0:15087:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787599508.692281:0:15087:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f6c7670b370) 00000020:00000080:0.0:1787599508.692290:0:15087:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787599508.693426:0:15087:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599508.693586:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787599508.693592:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787599508.697213:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599508.697224:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787599508.697519:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787599508.697526:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787599508.698755:0:15087:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599508.698926:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787599508.698932:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787599508.699491:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787599508.699498:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787599508.712773:0:15087:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599508.713021:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787599508.713028:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787599508.714104:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599508.714114:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787599508.714792:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787599508.714800:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787599508.719041:0:15087:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599508.719535:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787599508.719543:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787599508.720478:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787599508.720487:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787599508.770013:0:15087:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599508.770823:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787599508.770832:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787599508.772943:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787599508.772955:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787599508.776680:0:15087:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787599508.776706:0:15087:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787599508.776712:0:15087:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787599508.806967:0:15087:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787599508.807005:0:15087:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787599508.807009:0:15087:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787599508.807011:0:15087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599508.807013:0:15087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599508.807014:0:15087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599508.807016:0:15087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599508.807017:0:15087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599508.807018:0:15087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599508.807020:0:15087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599508.807021:0:15087:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787599508.807025:0:15087:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787599508.807027:0:15087:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599508.807029:0:15087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599508.807030:0:15087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599508.807031:0:15087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599508.807032:0:15087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599508.807033:0:15087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599508.807035:0:15087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599508.807036:0:15087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599508.807037:0:15087:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787599508.807062:0:15087:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787599508.807084:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543334912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787599508.807182:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599508.807973:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543334912 00000100:00100000:0.0:1787599508.807983:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543334912 00000100:00100000:0.0:1787599508.808051:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787599508.808061:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:15087:x1874433543334912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787599508.808106:0:14398:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787599508.808109:0:14398:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787599508.808113:0:14398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787599508.809779:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599508.837270:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:15087:x1874433543334912:12345-0@lo:253:mount.lustre.0 Request processed in 29202us (30079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599508.837286:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787599508.837468:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543334912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787599508.837483:0:15087:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787599508.837486:0:15087:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599508.837488:0:15087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599508.837489:0:15087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599508.837491:0:15087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599508.837492:0:15087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599508.837493:0:15087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599508.837495:0:15087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599508.837497:0:15087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599508.837498:0:15087:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787599508.837520:0:15087:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f6c58ba7000 from lustre-OST0000 10000000:01000000:3.0:1787599508.837557:0:15087:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787599508.837560:0:15087:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787599508.837567:0:15087:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f6c767099b8 local copy 00010000:00010000:3.0:1787599508.837577:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ce expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599508.837802:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599508.837839:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599508.837891:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599508.838129:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543335040 00000100:00100000:0.0:1787599508.838147:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543335040 00000100:00100000:0.0:1787599508.838213:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787599508.838222:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:15087:x1874433543335040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599508.838388:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:15087:x1874433543335040:12345-0@lo:501:mount.lustre.0 Request processed in 166us (548us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599508.838395:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787599508.838642:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335040:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787599508.838655:0:15087:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787599508.838799:0:15087:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787599508.838807:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ce expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599508.838817:0:15087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ce expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599508.838841:0:15087:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f6c58ba7000 10000000:01000000:3.0:1787599508.838846:0:15087:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787599508.838851:0:15087:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f6c767099b8 10000000:01000000:3.0:1787599508.838853:0:15087:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787599508.838857:0:15087:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f6c767099b8 from 1 10000000:01000000:3.0:1787599508.838860:0:15087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787599508.838894:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c76067c00/0xa46cbc67411836df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599508.838903:0:15087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c76067c00/0xa46cbc67411836df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599508.838923:0:15087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c76067c00/0xa46cbc67411836df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599508.838938:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599508.838972:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599508.839007:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a510c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599508.839086:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543335168 00000100:00100000:2.0:1787599508.839090:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543335168 00000100:00100000:2.0:1787599508.839125:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599508.839134:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+12:15087:x1874433543335168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599508.839185:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599508.839210:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40031000/0xa46cbc67411836e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411836df expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599508.839233:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40031000/0xa46cbc67411836e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411836df expref: 13 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599508.839243:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40031000/0xa46cbc67411836e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411836df expref: 13 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599508.839252:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031000, rc 0) 00000100:00100000:2.0:1787599508.839281:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+13:15087:x1874433543335168:12345-0@lo:101:mount.lustre.0 Request processed in 149us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599508.839293:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787599508.839608:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599508.839621:0:15087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c76067c00/0xa46cbc67411836df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836e6 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599508.839630:0:15087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c76067c00/0xa46cbc67411836df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411836e6 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599508.839645:0:15087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787599508.839665:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c76067c00/0xa46cbc67411836df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836e6 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599508.839672:0:15087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c76067c00/0xa46cbc67411836df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836e6 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599508.839678:0:15087:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787599508.839682:0:15087:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787599508.839686:0:15087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787599508.839688:0:15087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787599508.839701:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c76066200/0xa46cbc67411836ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599508.839708:0:15087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c76066200/0xa46cbc67411836ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599508.839720:0:15087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c76066200/0xa46cbc67411836ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599508.839731:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599508.839759:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599508.839786:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599508.840572:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543335296 00000100:00100000:0.0:1787599508.840579:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543335296 00000100:00100000:0.0:1787599508.840621:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599508.840628:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+13:15087:x1874433543335296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599508.840637:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599508.840650:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751fee00/0xa46cbc67411836f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411836ed expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.840666:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fee00/0xa46cbc67411836f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411836ed expref: 14 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.840676:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751fee00/0xa46cbc67411836f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411836ed expref: 14 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.840684:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fee00, rc 0) 00000100:00100000:0.0:1787599508.840726:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+14:15087:x1874433543335296:12345-0@lo:101:mount.lustre.0 Request processed in 99us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599508.840732:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599508.842033:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599508.842055:0:15087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c76066200/0xa46cbc67411836ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836f4 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599508.842067:0:15087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c76066200/0xa46cbc67411836ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411836f4 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599508.842970:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787599508.844324:0:15087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599508.846926:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787599508.847007:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787599508.847035:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787599508.847074:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787599508.847104:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787599508.847130:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787599508.854759:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787599508.854787:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787599508.854913:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599508.854984:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599508.855019:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599508.855107:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543335424 00000100:00100000:0.0:1787599508.855116:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543335424 00000100:00100000:0.0:1787599508.855203:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787599508.855213:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+14:15087:x1874433543335424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599508.855625:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+14:15087:x1874433543335424:12345-0@lo:501:mount.lustre.0 Request processed in 412us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599508.855645:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599508.856338:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599508.856391:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599508.856457:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599508.856497:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599508.856806:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543335552 00000100:00100000:2.0:1787599508.856813:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543335552 00000100:00100000:2.0:1787599508.856859:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787599508.856867:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+14:15087:x1874433543335552:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599508.857253:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+14:15087:x1874433543335552:12345-0@lo:503:mount.lustre.0 Request processed in 385us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599508.857261:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787599508.857584:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335552:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787599508.858253:0:15087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787599508.858324:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599508.858380:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599508.858409:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4525f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599508.858774:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543335680 00000100:00100000:3.0:1787599508.858781:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543335680 00000100:00100000:3.0:1787599508.858820:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787599508.858829:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+14:15087:x1874433543335680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599508.859063:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+14:15087:x1874433543335680:12345-0@lo:502:mount.lustre.0 Request processed in 234us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599508.859071:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787599508.859646:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599508.859913:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787599508.859981:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787599508.860015:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787599508.860060:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787599508.860095:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787599508.860134:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787599508.860226:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787599508.860263:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787599508.860295:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787599508.860340:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787599508.860375:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787599508.860555:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787599508.860593:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599508.862168:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599508.862220:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4525f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599508.862422:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543335808 00000100:00100000:3.0:1787599508.862450:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543335808 00000100:00100000:3.0:1787599508.862508:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787599508.862518:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+14:15087:x1874433543335808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599508.862744:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+14:15087:x1874433543335808:12345-0@lo:502:mount.lustre.0 Request processed in 228us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599508.862753:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787599508.863115:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599508.863273:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787599508.863286:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787599508.866024:0:15101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599508.866037:0:15101:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787599508.866044:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599508.866046:0:15101:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787599508.866057:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599508.866075:0:15101:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f6c7f7b99b8) 00000020:00000080:1.0:1787599508.866098:0:15101:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787599508.866103:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787599508.866239:0:15101:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6c58ba7000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787599508.866248:0:15101:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787599508.866255:0:15101:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa46cbc6741183702 00010000:00010000:1.0:1787599508.872977:0:15101:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787599508.873737:0:15101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787599508.877729:0:15101:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787599508.885810:0:15101:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787599508.885823:0:15101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599508.885830:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.885832:0:15101:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787599508.885836:0:15101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787599508.885838:0:15101:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787599508.885840:0:15101:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599508.885841:0:15101:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599508.885843:0:15101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787599508.885845:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.885846:0:15101:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787599508.885849:0:15101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599508.885852:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.885854:0:15101:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787599508.885856:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599508.885858:0:15101:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787599508.885860:0:15101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599508.885863:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.885864:0:15101:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787599508.885866:0:15101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599508.885868:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.885881:0:15101:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787599508.885886:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787599508.885961:0:15101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599508.885965:0:15101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.885966:0:15101:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787599508.885969:0:15101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787599508.888452:0:15087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787599508.888496:0:15087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787599508.888515:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c76066200/0xa46cbc67411836ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836f4 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599508.888527:0:15087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c76066200/0xa46cbc67411836ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411836f4 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599508.888536:0:15087:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c58ba7000 from 1 10000000:01000000:1.0:1787599508.888539:0:15087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787599508.888576:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599508.888585:0:15087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599508.888609:0:15087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599508.888634:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787599508.888701:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599508.888736:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599508.888821:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543335936 00000100:00100000:0.0:1787599508.888829:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543335936 00000100:00100000:0.0:1787599508.888885:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599508.888895:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+14:15087:x1874433543335936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599508.888907:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599508.888919:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751fe000/0xa46cbc6741183710 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741183709 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.888941:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fe000/0xa46cbc6741183710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741183709 expref: 15 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.888949:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751fe000/0xa46cbc6741183710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741183709 expref: 15 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.888957:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe000, rc 0) 00000100:00100000:0.0:1787599508.888991:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543335936:12345-0@lo:101:mount.lustre.0 Request processed in 99us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599508.888997:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787599508.891469:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543335936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599508.891495:0:15087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599508.891508:0:15087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599508.892037:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787599508.892780:0:15087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599508.893050:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787599508.893088:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787599508.894897:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787599508.894917:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787599508.895008:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599508.895073:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599508.895120:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599508.895274:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543336064 00000100:00100000:3.0:1787599508.895282:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543336064 00000100:00100000:3.0:1787599508.895327:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787599508.895337:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543336064:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599508.906135:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543336064:12345-0@lo:501:mount.lustre.0 Request processed in 10789us (11050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599508.906307:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787599508.906658:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599508.911120:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599508.913294:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599508.913339:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599508.913593:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543336192 00000100:00100000:3.0:1787599508.913604:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543336192 00000100:00100000:3.0:1787599508.913658:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787599508.913669:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543336192:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599508.913887:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543336192:12345-0@lo:503:mount.lustre.0 Request processed in 219us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599508.913894:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787599508.914729:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336192:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787599508.917690:0:15087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599508.917793:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599508.917881:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599508.917927:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c469a20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599508.918086:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543336320 00000100:00100000:3.0:1787599508.918094:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543336320 00000100:00100000:3.0:1787599508.918150:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787599508.918185:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543336320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599508.918363:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543336320:12345-0@lo:502:mount.lustre.0 Request processed in 179us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599508.918371:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599508.918620:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599508.918895:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787599508.918944:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787599508.919005:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787599508.919055:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787599508.919088:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787599508.919196:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787599508.919233:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787599508.919266:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787599508.919296:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599508.919341:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599508.919373:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c469a20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599508.919649:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543336448 00000100:00100000:1.0:1787599508.919655:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543336448 00000100:00100000:1.0:1787599508.919690:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787599508.919699:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543336448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599508.919863:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543336448:12345-0@lo:502:mount.lustre.0 Request processed in 165us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599508.919882:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599508.923405:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599508.923858:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787599508.923886:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787599508.928863:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599508.928887:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.928890:0:15105:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787599508.928897:0:15105:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6c58ba7000 00000020:00000080:2.0:1787599508.928900:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787599508.928907:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599508.928909:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.928911:0:15105:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787599508.928914:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599508.928916:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.928917:0:15105:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787599508.928921:0:15105:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6c58ba7000 00000020:00000080:2.0:1787599508.928923:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787599508.928982:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599508.928986:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.928988:0:15105:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787599508.928990:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599508.928993:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.928995:0:15105:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787599508.928998:0:15105:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f6c58ba7000 00000020:00000080:2.0:1787599508.929000:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787599508.929034:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599508.929039:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599508.929040:0:15105:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787599508.929043:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787599508.931615:0:15087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787599508.931658:0:15087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599508.931681:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.931694:0:15087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599508.931746:0:15087:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787599508.931749:0:15087:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f6c58ba7000 10000000:01000000:0.0:1787599508.931752:0:15087:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f6c58ba7000 10000000:01000000:0.0:1787599508.931756:0:15087:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599508.931761:0:15087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6c58ba7000 from 1 10000000:01000000:0.0:1787599508.931764:0:15087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787599508.931800:0:15087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe400/0xa46cbc6741183717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.931808:0:15087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe400/0xa46cbc6741183717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.931834:0:15087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe400/0xa46cbc6741183717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599508.931859:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599508.931939:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599508.931979:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c469a2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599508.932004:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543336576 00000100:00100000:0.0:1787599508.932011:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543336576 00000100:00100000:0.0:1787599508.932052:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787599508.932062:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543336576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599508.932074:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599508.932087:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751fe600/0xa46cbc674118371e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741183717 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.932109:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fe600/0xa46cbc674118371e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741183717 expref: 16 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.932119:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751fe600/0xa46cbc674118371e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741183717 expref: 16 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599508.932128:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe600, rc 0) 00000100:00100000:0.0:1787599508.936376:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15087:x1874433543336576:12345-0@lo:101:mount.lustre.0 Request processed in 4306us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599508.936388:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787599508.936563:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599508.936590:0:15087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe400/0xa46cbc6741183717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118371e expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599508.936604:0:15087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe400/0xa46cbc6741183717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc674118371e expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599508.937195:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787599508.937492:0:15087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599508.937736:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787599508.937778:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787599508.937810:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787599508.937854:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787599508.937904:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787599508.937985:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787599508.938025:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787599508.938058:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787599508.938104:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787599508.938136:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787599508.938192:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787599508.938256:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787599508.938300:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787599508.938331:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787599508.938376:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787599508.938412:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787599508.938441:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787599508.938502:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787599508.938539:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787599508.938569:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787599508.938613:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787599508.938666:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787599508.938696:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787599508.938737:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787599508.938770:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787599508.938798:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787599508.938841:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787599508.938897:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787599508.938967:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787599508.938974:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787599508.939054:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599508.939114:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599508.939187:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599508.942214:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543336704 00000100:00100000:0.0:1787599508.942228:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543336704 00000100:00100000:0.0:1787599508.942288:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787599508.942300:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15087:x1874433543336704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599508.958587:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15087:x1874433543336704:12345-0@lo:501:mount.lustre.0 Request processed in 16280us (19463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599508.958602:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787599508.958635:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599508.958687:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599508.958742:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599508.958779:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599508.961547:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543336832 00000100:00100000:0.0:1787599508.961562:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543336832 00000100:00100000:0.0:1787599508.961621:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787599508.961632:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15087:x1874433543336832:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599508.961879:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15087:x1874433543336832:12345-0@lo:503:mount.lustre.0 Request processed in 236us (3125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599508.961887:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787599508.961962:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336832:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787599508.967011:0:15087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599508.967101:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75dea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599508.971756:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599508.971805:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b442a9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599508.971838:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543336960 00000100:00100000:0.0:1787599508.971846:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543336960 00000100:00100000:0.0:1787599508.971910:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787599508.971930:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15087:x1874433543336960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599508.972219:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15087:x1874433543336960:12345-0@lo:502:mount.lustre.0 Request processed in 300us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599508.972228:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787599508.972285:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75dea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543336960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599508.976315:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787599508.976410:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787599508.977379:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787599508.977672:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787599508.977717:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787599508.977768:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787599508.977804:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787599508.977856:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787599508.977921:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787599508.977956:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787599508.977988:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787599508.978047:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787599508.978086:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787599508.978118:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787599508.981902:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787599508.982857:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787599508.982912:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787599508.984470:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787599508.984521:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787599508.984557:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787599508.984608:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787599508.984644:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787599508.984674:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787599508.984740:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787599508.984778:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787599508.984811:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787599508.984860:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787599508.984911:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787599508.984958:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787599508.985006:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787599508.985041:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787599508.985069:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787599508.985095:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787599508.985152:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787599508.985207:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787599508.985273:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787599508.985309:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787599508.985340:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787599508.985385:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787599508.985441:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787599508.985492:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75dea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543337088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599508.985567:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599508.985613:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599508.985648:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543337088 00000100:00100000:0.0:1787599508.985656:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543337088 00000100:00100000:0.0:1787599508.985710:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787599508.998739:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15087:x1874433543337088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599508.999037:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15087:x1874433543337088:12345-0@lo:502:mount.lustre.0 Request processed in 13318us (13468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599508.999046:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787599509.005769:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75dea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543337088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599509.005939:0:15087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787599509.005957:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787599509.008964:0:15110:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787599509.008985:0:15110:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f6c7f7bb370) 00000020:00000080:1.0:1787599509.009003:0:15110:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787599509.009084:0:15110:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6c58ba7000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787599509.009088:0:15110:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f6c58ba7000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787599509.009091:0:15110:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6c58ba7000 3 00010000:00080000:1.0:1787599509.009125:0:15110:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f6c6dd54000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1787599509.012999:0:15110:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787599509.013194:0:15110:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787599509.013229:0:15110:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787599509.013244:0:15110:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa46cbc674118372c 00000100:00080000:1.0:1787599509.013254:0:15110:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599509.013260:0:15110:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f6c6dd54000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1787599509.013293:0:15110:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c76120380 x1874433543337216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599509.013319:0:15110:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787599509.014576:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874433543337216:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787599509.014654:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599509.018152:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543337216 00000100:00100000:1.0:1787599509.018204:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543337216 00000100:00100000:1.0:1787599509.018252:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599509.018261:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1874433543337216:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787599509.018302:0:14406:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:1.0:1787599509.018363:0:14406:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa46cbc6741183733 00000004:00100000:1.0:1787599509.018394:0:14406:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787599509.018440:0:14406:0:(import.c:65:import_set_state_nolock()) ffff9f6b4664e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599509.018832:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874433543337216:12345-0@lo:38:llog_process_th.0 Request processed in 569us (4176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599509.018840:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787599509.018928:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f6c76120380 x1874433543337216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599509.018962:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599509.018972:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787599509.018980:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787599509.018985:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787599509.018987:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c6dd54000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787599509.018993:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874433543337216:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787599509.019606:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599509.019611:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599509.019614:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599509.019617:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787599509.019681:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543337344:0@lo:400:kworker.0 00000100:00100000:3.0:1787599509.019749:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599509.019830:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543337344 00000100:00100000:2.0:1787599509.019836:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543337344 00000100:00100000:2.0:1787599509.019890:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599509.019899:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543337344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599509.019962:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543337344:12345-0@lo:400:kworker.0 Request processed in 64us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599509.019968:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787599509.020000:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f6c7609d880 x1874433543337344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599509.020010:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543337344:0@lo:400:kworker.0 00000040:00080000:0.0:1787599509.020372:0:15110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787599509.021285:0:15087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787599509.021312:0:15087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787599509.021333:0:15087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe400/0xa46cbc6741183717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118371e expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.021344:0:15087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751fe400/0xa46cbc6741183717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118371e expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787599509.021393:0:15087:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787599509.021395:0:15087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787599509.021396:0:15087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599509.021402:0:15087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599509.021403:0:15087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599509.021404:0:15087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599509.021406:0:15087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599509.021407:0:15087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599509.021408:0:15087:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599509.021412:0:15087:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787599509.021414:0:15087:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599509.021415:0:15087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787599509.021416:0:15087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599509.021417:0:15087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599509.021418:0:15087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599509.021419:0:15087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599509.021420:0:15087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599509.021420:0:15087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599509.021421:0:15087:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599509.021452:0:15087:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787599509.021468:0:15087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543337472:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787599509.021519:0:15087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599509.021558:0:15087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b46643540 going to sleep for 11 seconds 00000100:00100000:2.0:1787599509.021618:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543337472 00000100:00100000:2.0:1787599509.021625:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543337472 00000100:00100000:2.0:1787599509.021668:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787599509.021677:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15087:x1874433543337472:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787599509.021716:0:14398:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787599509.021731:0:14398:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787599509.086118:0:14398:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787599509.086144:0:14398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787599509.086323:0:14421:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787599509.086329:0:14421:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787599509.086359:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.086390:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c76067800/0xa46cbc67411836a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411836a0 expref: 16 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.086399:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.086449:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c76067800/0xa46cbc67411836a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411836a0 expref: 16 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.086463:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c76067800/0xa46cbc67411836a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411836a0 expref: 16 pid: 14399 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599509.086500:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75dea680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14421:1874433543337600:0@lo:104: 00000100:00100000:0.0:1787599509.086740:0:14421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599509.086798:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c469a20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599509.086939:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543337600 00000100:00100000:1.0:1787599509.086948:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543337600 00000100:00100000:1.0:1787599509.086998:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599509.087008:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+3:14421:x1874433543337600:12345-0@lo:104: 00010000:00010000:1.0:1787599509.087021:0:14389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.087070:0:14389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787599509.087076:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+3:14421:x1874433543337600:12345-0@lo:104: Request processed in 71us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599509.087083:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787599509.087270:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599509.087277:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599509.087296:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddec00 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599509.087300:0:14393:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599509.087319:0:14393:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599509.087328:0:14393:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599509.087334:0:14393:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599509.087365:0:14393:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599509.087372:0:14393:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599509.087509:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599509.087640:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddec00/0xa46cbc67411836a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411836a7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599509.087657:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599509.087659:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599509.087661:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599509.087675:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543337728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599509.087710:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599509.087818:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75dea680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14421:1874433543337600:0@lo:104: 00010000:00010000:0.0:1787599509.087837:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599509.088693:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543337728 00000100:00100000:1.0:1787599509.088700:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543337728 00010000:00010000:1.0:1787599509.088727:0:14391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c76067800/0xa46cbc67411836a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411836a0 expref: 17 pid: 14399 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599509.088755:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599509.088763:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:3302:x1874433543337728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599509.088774:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599509.088780:0:14391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c76067800/0xa46cbc67411836a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411836a0 expref: 17 pid: 14399 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088802:0:14391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c76067800/0xa46cbc67411836a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411836a0 expref: 17 pid: 14399 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088819:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c76067800/0xa46cbc67411836a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411836a0 expref: 17 pid: 14399 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088835:0:14391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088843:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787599509.088859:0:14391:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002531080s 00010000:00010000:1.0:1787599509.088864:0:14391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088885:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088891:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088898:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088904:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c751ff600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599509.088909:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088916:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088940:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599509.088949:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599509.089185:0:14421:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.089195:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599509.089201:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118373a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599509.089278:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:3302:x1874433543337728:12345-0@lo:103:ldlm_bl.0 Request processed in 515us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599509.089295:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599509.090263:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543337728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599509.104826:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:15087:x1874433543337472:12345-0@lo:253:mount.lustre.0 Request processed in 83137us (83294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599509.104841:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787599509.104963:0:15087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15087:1874433543337472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787599509.104979:0:15087:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787599509.104983:0:15087:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787599509.104984:0:15087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787599509.104986:0:15087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599509.104987:0:15087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599509.104988:0:15087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599509.104990:0:15087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599509.104991:0:15087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599509.104993:0:15087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599509.104994:0:15087:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787599509.105007:0:15087:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787599509.110735:0:15087:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787599509.110930:0:15087:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787599509.111269:0:15087:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787599509.111677:0:15087:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787599509.111827:0:15087:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787599509.112314:0:15087:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787599509.113727:0:15087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1787599509.153410:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787599509.189320:0:15087:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787599509.189330:0:15087:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787599509.189365:0:15087:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787599509.189505:0:15087:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787599509.189522:0:15087:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787599509.189551:0:15087:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787599510.183854:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787599510.564814:0:14402:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787599510.564821:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f6b45127800 from 7 10000000:01000000:1.0:1787599510.564826:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787599510.564878:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599510.564890:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599510.564902:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599510.564926:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76120380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543337856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599510.564988:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599510.565034:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7f7dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599510.565054:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543337856 00000100:00100000:1.0:1787599510.565060:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543337856 00000100:00100000:1.0:1787599510.565108:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787599510.565117:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+15:14402:x1874433543337856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599510.565130:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599510.565150:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75ddee00/0xa46cbc6741183748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741183741 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599510.565195:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75ddee00/0xa46cbc6741183748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741183741 expref: 16 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599510.565206:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75ddee00/0xa46cbc6741183748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741183741 expref: 16 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599510.565216:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75ddee00, rc 0) 00000100:00100000:1.0:1787599510.565256:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:14402:x1874433543337856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599510.565263:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787599510.565309:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76120380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543337856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599510.565322:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599510.565331:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599510.565380:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76120380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543337984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787599510.565410:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599510.565435:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7f7dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599510.565588:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543337984 00000100:00100000:0.0:1787599510.565593:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543337984 00000100:00100000:0.0:1787599510.565617:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787599510.565625:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:14402:x1874433543337984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787599510.565647:0:14400:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787599510.565664:0:14400:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787599510.565668:0:14400:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787599510.565746:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:14402:x1874433543337984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599510.565754:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787599510.570891:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76120380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543337984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787599510.570975:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787599510.570987:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599510.571008:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599511.201359:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599512.227101:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599513.257580:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599514.150928:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599514.150937:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599514.150941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599514.150944:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787599514.151104:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543338240:0@lo:400:kworker.0 00000100:00100000:0.0:1787599514.151231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599514.151302:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599514.151309:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3300:1874433543338112:0@lo:400:kworker.0 00000100:00100000:0.0:1787599514.151581:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599514.151630:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543338368:0@lo:400:kworker.0 00000100:00100000:0.0:1787599514.151732:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599514.151792:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543338240 00000100:00100000:0.0:1787599514.151802:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543338240 00000100:00100000:0.0:1787599514.151855:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543338368 00000100:00100000:0.0:1787599514.151858:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543338368 00000100:00100000:0.0:1787599514.151891:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599514.151900:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543338240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599514.151963:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543338240:12345-0@lo:400:kworker.0 Request processed in 63us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599514.151970:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599514.151990:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599514.151996:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543338368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599514.152028:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543338368:12345-0@lo:400:kworker.0 Request processed in 31us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599514.152034:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599514.152053:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543338112 00000100:00100000:0.0:1787599514.152057:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543338112 00000100:00100000:0.0:1787599514.152082:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787599514.152088:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:3300:x1874433543338112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599514.152118:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:3300:x1874433543338112:12345-0@lo:400:kworker.0 Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599514.152139:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787599514.153224:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3300:1874433543338112:0@lo:400:kworker.0 00010000:00080000:1.0:1787599514.153249:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c75dea680 x1874433543338240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599514.153263:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543338240:0@lo:400:kworker.0 00010000:00080000:1.0:1787599514.154908:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c75de8a80 x1874433543338368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599514.154929:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543338368:0@lo:400:kworker.0 00000100:00080000:2.0:1787599514.156189:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787599514.275279:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599515.306358:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787599515.683856:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787599516.327555:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787599517.004843:0:15453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787599517.346179:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599518.241211:0:3298:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599503/real 1787599503] req@ffff9f6c466eea00 x1874433543333888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599518 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599518.241240:0:3298:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f6c466eea00 x1874433543333888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599518 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599518.241251:0:3298:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599503/real 1787599503] req@ffff9f6c466eed80 x1874433543334016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599518 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599518.241263:0:3298:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f6c466eed80 x1874433543334016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599518 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787599518.241282:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c580a8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599518.241301:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787599518.241305:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543333888:0@lo:8:kworker.0 00000100:00080000:2.0:1787599518.241311:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599518.241316:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787599518.241319:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543334016:0@lo:8:kworker.0 00000100:00080000:3.0:1787599518.243285:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599518.243293:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787599518.243296:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f6c580a8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599518.243303:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1787599518.243309:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787599518.243316:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f6c580a8800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787599518.243340:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c7609e680 x1874433543338624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599518.243357:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599518.243361:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787599518.243363:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599518.243366:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1787599518.243368:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787599518.243372:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f6c7662b000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787599518.243383:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c7609ce00 x1874433543338752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599518.243432:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543338496:0@lo:400:kworker.0 00000100:00100000:3.0:1787599518.247314:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599518.247420:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543338624:0@lo:8:kworker.0 00000100:00100000:3.0:1787599518.247486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599518.247508:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543338752:0@lo:8:kworker.0 00000100:00100000:3.0:1787599518.247535:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599518.247562:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543338880:0@lo:400:kworker.0 00000100:00100000:3.0:1787599518.247602:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599518.247622:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599518.247628:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543339008:0@lo:400:kworker.0 00000100:00100000:3.0:1787599518.247653:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599518.247713:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543338624 00000100:00100000:3.0:1787599518.247720:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543338624 00000100:00100000:3.0:1787599518.247749:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543338752 00000100:00100000:3.0:1787599518.247752:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543338752 00000100:00100000:3.0:1787599518.247765:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599518.247773:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1874433543338624:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787599518.247802:0:15088:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:3.0:1787599518.247830:0:15088:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa46cbc674118374f 00002000:00100000:3.0:1787599518.247843:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f6c75999800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787599518.247849:0:15088:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787599518.247851:0:15088:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787599518.248397:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787599518.248422:0:15088:0:(import.c:65:import_set_state_nolock()) ffff9f6c7599c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599518.249632:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1874433543338624:12345-0@lo:8:kworker.0 Request processed in 1854us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599518.249643:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599518.249743:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599518.249751:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1874433543338752:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787599518.249768:0:15088:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787599518.249810:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1874433543338752:12345-0@lo:8:kworker.0 Request processed in 59us (2274us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599518.249816:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599518.249857:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543338880 00000100:00100000:3.0:1787599518.249863:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543338880 00000100:00100000:3.0:1787599518.249904:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543339008 00000100:00100000:3.0:1787599518.249907:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543339008 00000100:00100000:3.0:1787599518.249931:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599518.249936:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543338880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599518.250066:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543338496 00000100:00100000:0.0:1787599518.250070:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543338496 00000100:00100000:0.0:1787599518.250100:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787599518.250106:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:3302:x1874433543338496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599518.256260:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:3302:x1874433543338496:12345-0@lo:400:kworker.0 Request processed in 6147us (8945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599518.256275:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787599518.256340:0:14406:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787599518.256348:0:14406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787599518.256458:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543338496:0@lo:400:kworker.0 00000100:00100000:0.0:1787599518.256522:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599518.256535:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543339008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599518.256591:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543339008:12345-0@lo:400:kworker.0 Request processed in 61us (8937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599518.256597:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599518.265834:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543338880:12345-0@lo:400:kworker.0 Request processed in 15886us (18219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599518.265850:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787599518.265906:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787599518.267619:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c7609d880 x1874433543339008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599518.267639:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543339008:0@lo:400:kworker.0 00010000:00080000:3.0:1787599518.267654:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c7609e300 x1874433543338880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599518.267663:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543338880:0@lo:400:kworker.0 00010000:00080000:3.0:1787599518.267734:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c7609e680 x1874433543338624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599518.267743:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599518.267752:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787599518.267761:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787599518.267767:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787599518.267770:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c580a8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787599518.267787:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787599518.267793:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543338624:0@lo:8:kworker.0 00000100:00080000:3.0:1787599518.267806:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599518.267819:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599518.267823:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543338752:0@lo:8:kworker.0 00000004:00080000:1.0:1787599518.267920:0:14428:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787599518.267942:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14428:1874433543339264:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787599518.268013:0:14428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599518.268065:0:14428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599518.268107:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543339136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599518.268133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599518.268386:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543339136 00000100:00100000:2.0:1787599518.268394:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543339136 00000100:00100000:2.0:1787599518.268570:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599518.268581:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874433543339136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599518.268612:0:15092:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599518.268680:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874433543339136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599518.268687:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1787599518.270488:0:14427:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787599518.270925:0:14427:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 475644767170ns, next at 0ns, rc = 0 00010000:00080000:0.0:1787599518.271234:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c76120380 x1874433543339136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599518.271255:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543339136:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787599518.272220:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599518.272255:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543339264 00000100:00100000:3.0:1787599518.272262:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543339264 00000100:00100000:3.0:1787599518.272312:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599518.272322:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14428:x1874433543339264:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787599518.274855:0:15088:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787599518.274866:0:15088:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787599518.274871:0:15088:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1787599518.302250:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.302263:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc6741183756 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.302280:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.302286:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.307572:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc6741183756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.307611:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc6741183756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.307623:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc6741183756 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.307632:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc6741183756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.307668:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599518.307685:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599518.307703:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc6741183756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.307711:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.307715:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc6741183756 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.307734:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc6741183756 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.307751:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc6741183756 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.307758:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc6741183756 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.307780:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.307782:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.307784:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.308559:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.308566:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc674118375d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.308578:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.308587:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.308593:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc674118375d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.308603:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc674118375d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.308612:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc674118375d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.308619:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc674118375d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.308634:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599518.308642:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599518.308647:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc674118375d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.308653:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.308656:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc674118375d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.308664:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc674118375d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.308674:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc674118375d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.308701:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc674118375d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.308715:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.308726:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.308728:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.309175:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.309181:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc6741183764 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.309190:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.309193:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.309197:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc6741183764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.309206:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc6741183764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.309214:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc6741183764 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.309221:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc6741183764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.309233:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599518.309240:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599518.309248:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc6741183764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.309254:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066a00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.309258:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc6741183764 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.309266:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc6741183764 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.309276:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc6741183764 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.309283:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc6741183764 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.309296:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.309298:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.309300:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.310429:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.310438:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc674118376b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.310449:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.310452:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.310456:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc674118376b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.312281:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc674118376b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.312292:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc674118376b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.312301:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc674118376b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.312324:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599518.313116:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599518.313129:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc674118376b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599518.313150:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:0.0:1787599518.313179:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc674118376b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599518.313189:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc674118376b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599518.313210:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc674118376b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599518.313217:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc674118376b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599518.313235:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599518.313237:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599518.313238:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.313611:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.313619:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183772 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.313629:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.313634:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.313640:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183772 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.313649:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183772 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.313658:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183772 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.314753:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183772 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599518.315012:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599518.315019:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183772 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599518.315027:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599518.315031:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183772 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599518.315039:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183772 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599518.315056:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183772 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599518.315078:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599518.315080:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599518.315081:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.317073:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787599518.317085:0:15088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183772 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787599518.317898:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.317907:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183779 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.317920:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.317925:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.317931:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183779 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.317945:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183779 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.317955:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183779 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.320057:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183779 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.322653:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599518.322674:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599518.322682:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183779 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.322806:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.322812:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183779 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.322824:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183779 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.322847:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183779 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.322855:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183779 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.322874:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.322876:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.322878:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.332488:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.332503:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183780 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.332521:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.332532:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.332539:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.332555:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.332565:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.332573:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183780 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.332594:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599518.332607:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599518.332613:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183780 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.332620:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.332625:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183780 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.332634:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183780 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.332652:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183780 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.332671:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb8cbac/0xa46cbc6741183780 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.332904:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.332907:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.332909:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.334391:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.334402:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183787 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.334415:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.334419:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.334424:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.334435:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.334444:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.334452:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183787 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.334608:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599518.334621:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599518.334634:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183787 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.334641:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.334644:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183787 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.334653:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183787 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.334666:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183787 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.334672:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e5876fd/0xa46cbc6741183787 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.334685:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.334697:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.334700:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.335201:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.335207:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc674118378e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.335217:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.335219:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.335223:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc674118378e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.335579:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc674118378e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.335591:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc674118378e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.335599:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc674118378e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.335619:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787599518.335990:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.335996:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc6741183795 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336005:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.336009:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.336013:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc6741183795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336022:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc6741183795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336030:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc6741183795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336048:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc6741183795 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336060:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787599518.336068:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599518.336073:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc674118378e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336080:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066a00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.336083:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc674118378e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336090:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc674118378e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336103:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc674118378e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336111:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000846d370/0xa46cbc674118378e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336125:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599518.336128:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc6741183795 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336146:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.336150:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc6741183795 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336178:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc6741183795 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336189:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc6741183795 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336196:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e19c24e9/0xa46cbc6741183795 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.336207:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.336209:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.336211:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599518.336488:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.341315:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.341328:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc674118379c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.341346:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.341351:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.341357:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc674118379c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.341371:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc674118379c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.341390:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc674118379c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.341399:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc674118379c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.341420:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599518.341631:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599518.341639:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc674118379c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.341648:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.341653:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc674118379c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.341668:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc674118379c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.341698:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc674118379c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.341706:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000507fcd27/0xa46cbc674118379c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.342150:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.342153:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.342169:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.342729:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.342737:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411837a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.342747:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.342750:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.342755:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411837a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.342766:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411837a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.342774:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411837a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.342780:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411837a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.342807:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787599518.343259:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.343265:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061112e0a/0xa46cbc67411837aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.343273:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.343277:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.343281:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061112e0a/0xa46cbc67411837aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.343290:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061112e0a/0xa46cbc67411837aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.343298:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061112e0a/0xa46cbc67411837aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.343305:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061112e0a/0xa46cbc67411837aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.343320:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787599518.343701:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.343708:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffc97083/0xa46cbc67411837b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.343715:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.343724:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.343728:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc97083/0xa46cbc67411837b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.343739:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffc97083/0xa46cbc67411837b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.343748:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffc97083/0xa46cbc67411837b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.343755:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffc97083/0xa46cbc67411837b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.343763:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787599518.344127:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.344133:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e1a529b/0xa46cbc67411837b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.344141:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.344144:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.344147:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e1a529b/0xa46cbc67411837b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.344178:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e1a529b/0xa46cbc67411837b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.344187:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e1a529b/0xa46cbc67411837b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.344201:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e1a529b/0xa46cbc67411837b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.344209:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787599518.344588:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.344594:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dff9ff/0xa46cbc67411837bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.344603:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.344606:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.344610:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dff9ff/0xa46cbc67411837bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.344619:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0dff9ff/0xa46cbc67411837bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.344626:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dff9ff/0xa46cbc67411837bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.344633:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dff9ff/0xa46cbc67411837bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.344642:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787599518.345034:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.345039:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc67411837c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.345051:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.345054:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.345057:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc67411837c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.345066:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc67411837c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.345074:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc67411837c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.345080:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc67411837c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.345088:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1787599518.345340:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787599518.345348:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411837a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345356:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067e00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.345361:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411837a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345369:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411837a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345385:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411837a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345404:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008af53450/0xa46cbc67411837a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345425:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787599518.345428:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061112e0a/0xa46cbc67411837aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345435:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.345438:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061112e0a/0xa46cbc67411837aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345446:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061112e0a/0xa46cbc67411837aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345456:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061112e0a/0xa46cbc67411837aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345473:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061112e0a/0xa46cbc67411837aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345485:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787599518.345488:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffc97083/0xa46cbc67411837b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345494:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066c00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.345502:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffc97083/0xa46cbc67411837b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345510:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffc97083/0xa46cbc67411837b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345520:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffc97083/0xa46cbc67411837b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345527:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffc97083/0xa46cbc67411837b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345541:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787599518.345544:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e1a529b/0xa46cbc67411837b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345550:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067a00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.345553:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e1a529b/0xa46cbc67411837b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345559:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e1a529b/0xa46cbc67411837b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345566:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e1a529b/0xa46cbc67411837b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345572:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e1a529b/0xa46cbc67411837b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345589:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599518.345592:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0dff9ff/0xa46cbc67411837bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345597:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76066400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.345600:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dff9ff/0xa46cbc67411837bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345607:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dff9ff/0xa46cbc67411837bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345615:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0dff9ff/0xa46cbc67411837bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345622:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0dff9ff/0xa46cbc67411837bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345636:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599518.345639:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc67411837c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345644:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.345647:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc67411837c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345664:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc67411837c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345675:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc67411837c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345682:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aea090e/0xa46cbc67411837c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.345707:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.345709:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.345711:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599518.347650:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.356295:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.356310:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbcdcb75/0xa46cbc67411837cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.356327:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.356332:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.356339:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbcdcb75/0xa46cbc67411837cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.356354:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbcdcb75/0xa46cbc67411837cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.356377:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbcdcb75/0xa46cbc67411837cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.356385:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbcdcb75/0xa46cbc67411837cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.356406:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787599518.356890:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.356896:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb5aa513/0xa46cbc67411837d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.356905:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.356908:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.356913:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb5aa513/0xa46cbc67411837d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.356923:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb5aa513/0xa46cbc67411837d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.356931:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb5aa513/0xa46cbc67411837d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.356938:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb5aa513/0xa46cbc67411837d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.356964:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787599518.357386:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.357392:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b596fff8/0xa46cbc67411837db lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.357401:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.357404:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.357408:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b596fff8/0xa46cbc67411837db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.357417:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b596fff8/0xa46cbc67411837db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.357424:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b596fff8/0xa46cbc67411837db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.357432:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b596fff8/0xa46cbc67411837db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.357440:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787599518.357813:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.357819:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c5a5869/0xa46cbc67411837e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.357827:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.357834:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.357838:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c5a5869/0xa46cbc67411837e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.357847:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c5a5869/0xa46cbc67411837e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.357854:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c5a5869/0xa46cbc67411837e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.357860:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c5a5869/0xa46cbc67411837e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.357868:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787599518.358258:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.358263:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e1563c2/0xa46cbc67411837e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.358271:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.358274:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.358278:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e1563c2/0xa46cbc67411837e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.358285:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e1563c2/0xa46cbc67411837e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.358292:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e1563c2/0xa46cbc67411837e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.358305:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e1563c2/0xa46cbc67411837e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.358313:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1787599518.360607:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787599518.360622:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbcdcb75/0xa46cbc67411837cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360636:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24ca00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.360642:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbcdcb75/0xa46cbc67411837cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360652:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbcdcb75/0xa46cbc67411837cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360674:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbcdcb75/0xa46cbc67411837cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360712:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbcdcb75/0xa46cbc67411837cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360747:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787599518.360751:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb5aa513/0xa46cbc67411837d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360757:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24cc00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.360760:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb5aa513/0xa46cbc67411837d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360768:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb5aa513/0xa46cbc67411837d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360778:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb5aa513/0xa46cbc67411837d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360784:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb5aa513/0xa46cbc67411837d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360796:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787599518.360800:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b596fff8/0xa46cbc67411837db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360807:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24dc00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.360815:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b596fff8/0xa46cbc67411837db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360824:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b596fff8/0xa46cbc67411837db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360834:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b596fff8/0xa46cbc67411837db lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360841:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b596fff8/0xa46cbc67411837db lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360853:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599518.360856:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c5a5869/0xa46cbc67411837e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360862:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.360865:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c5a5869/0xa46cbc67411837e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360873:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c5a5869/0xa46cbc67411837e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360881:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c5a5869/0xa46cbc67411837e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360888:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c5a5869/0xa46cbc67411837e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360905:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599518.360908:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e1563c2/0xa46cbc67411837e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360915:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24ce00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.360918:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e1563c2/0xa46cbc67411837e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360925:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e1563c2/0xa46cbc67411837e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360934:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e1563c2/0xa46cbc67411837e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360941:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e1563c2/0xa46cbc67411837e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.360951:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.360953:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.360955:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.361202:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787599518.362845:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787599518.363811:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.363821:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043710fc1/0xa46cbc67411837f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.363837:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.363842:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.363848:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043710fc1/0xa46cbc67411837f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.363862:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043710fc1/0xa46cbc67411837f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.363872:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043710fc1/0xa46cbc67411837f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.363879:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043710fc1/0xa46cbc67411837f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.363896:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599518.363907:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599518.363913:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043710fc1/0xa46cbc67411837f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.363926:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.363931:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043710fc1/0xa46cbc67411837f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.363940:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043710fc1/0xa46cbc67411837f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.363956:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043710fc1/0xa46cbc67411837f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.363976:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043710fc1/0xa46cbc67411837f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.363996:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.363998:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.364000:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.364430:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.364436:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef7dfe5d/0xa46cbc67411837f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364444:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.364447:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.364451:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef7dfe5d/0xa46cbc67411837f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364460:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef7dfe5d/0xa46cbc67411837f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364474:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef7dfe5d/0xa46cbc67411837f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364481:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef7dfe5d/0xa46cbc67411837f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364492:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787599518.364880:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.364886:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97e3051/0xa46cbc67411837fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364894:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.364898:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.364902:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a97e3051/0xa46cbc67411837fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364910:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a97e3051/0xa46cbc67411837fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364918:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97e3051/0xa46cbc67411837fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364925:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a97e3051/0xa46cbc67411837fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364965:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787599518.364975:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599518.364979:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef7dfe5d/0xa46cbc67411837f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364985:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.364989:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef7dfe5d/0xa46cbc67411837f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.364997:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef7dfe5d/0xa46cbc67411837f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365009:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef7dfe5d/0xa46cbc67411837f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365016:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef7dfe5d/0xa46cbc67411837f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365032:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599518.365036:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a97e3051/0xa46cbc67411837fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365042:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24de00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.365046:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97e3051/0xa46cbc67411837fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365065:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97e3051/0xa46cbc67411837fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365075:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a97e3051/0xa46cbc67411837fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365081:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a97e3051/0xa46cbc67411837fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365094:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.365096:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.365097:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.365521:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.365528:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b130bd6/0xa46cbc6741183805 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365537:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.365540:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.365545:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b130bd6/0xa46cbc6741183805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365554:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b130bd6/0xa46cbc6741183805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365562:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b130bd6/0xa46cbc6741183805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365580:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b130bd6/0xa46cbc6741183805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365592:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599518.365600:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599518.365603:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b130bd6/0xa46cbc6741183805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365609:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599518.365612:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b130bd6/0xa46cbc6741183805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365619:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b130bd6/0xa46cbc6741183805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365629:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b130bd6/0xa46cbc6741183805 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365635:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b130bd6/0xa46cbc6741183805 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.365649:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.365651:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599518.365652:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.366918:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599518.369232:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599518.369261:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075747254/0xa46cbc674118380c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.369278:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=475s v=(0 0) 00010000:00010000:3.0:1787599518.369283:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599518.369288:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075747254/0xa46cbc674118380c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.369302:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075747254/0xa46cbc674118380c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.369313:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075747254/0xa46cbc674118380c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.369321:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075747254/0xa46cbc674118380c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599518.370569:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787599518.371080:0:15088:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1787599518.371201:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14428:x1874433543339264:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98876us (103183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599518.371211:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599518.371354:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14428:1874433543339264:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787599518.371369:0:14428:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787599518.371414:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14428:1874433543339392:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787599518.371452:0:14428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599518.371607:0:14428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c50f73180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599518.371630:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543339392 00000100:00100000:2.0:1787599518.371638:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543339392 00000100:00100000:2.0:1787599518.371681:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599518.371699:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14428:x1874433543339392:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787599518.371745:0:15091:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1787599518.373420:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599518.373431:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075747254/0xa46cbc674118380c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.373453:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599518.373458:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075747254/0xa46cbc674118380c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.374038:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075747254/0xa46cbc674118380c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.374060:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075747254/0xa46cbc674118380c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.374068:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075747254/0xa46cbc674118380c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599518.374087:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.374089:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.374091:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599518.374134:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599518.382900:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14428:x1874433543339392:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11204us (11441us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787599518.382914:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599518.383272:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14428:1874433543339392:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787599518.383288:0:14428:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:0.0:1787599519.390430:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787599519.390487:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787599519.403051:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599520.423302:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599521.442241:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599522.482673:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599523.363186:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543339520:0@lo:400:kworker.0 00000100:00100000:1.0:1787599523.363273:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599523.363340:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543339520 00000100:00100000:0.0:1787599523.363350:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543339520 00000100:00100000:0.0:1787599523.363404:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787599523.363407:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543339648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599523.363416:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:3302:x1874433543339520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599523.363443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599523.363481:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:3302:x1874433543339520:12345-0@lo:400:kworker.0 Request processed in 67us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599523.363496:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787599523.363497:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543339648 00000100:00100000:1.0:1787599523.363502:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543339648 00000100:00100000:1.0:1787599523.363546:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599523.363555:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543339648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599523.363583:0:15092:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599523.363632:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543339648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599523.363639:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787599523.363655:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599523.364601:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787599523.364628:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543339648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599523.364656:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543339520:0@lo:400:kworker.0 00000100:00080000:3.0:1787599523.369782:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599523.369790:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787599523.369793:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599523.369800:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:3.0:1787599523.369804:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787599523.369819:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f6c7662b000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1787599523.370477:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c7609e680 x1874433543339776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599523.370512:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543339776:0@lo:8:kworker.0 00000100:00100000:3.0:1787599523.370583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599523.370654:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543339776 00000100:00100000:3.0:1787599523.370663:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543339776 00000100:00100000:3.0:1787599523.370718:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599523.370726:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1874433543339776:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787599523.370753:0:15088:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787599523.378313:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543339904:0@lo:400:kworker.0 00000100:00100000:2.0:1787599523.378385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599523.378437:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543339904 00000100:00100000:2.0:1787599523.378446:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543339904 00000100:00100000:2.0:1787599523.378497:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599523.378506:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543339904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599523.378579:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543339904:12345-0@lo:400:kworker.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599523.378614:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787599523.378657:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c466ef480 x1874433543339904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599523.378673:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543339904:0@lo:400:kworker.0 00000100:00100000:2.0:1787599523.378722:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543340032:0@lo:400:kworker.0 00000100:00100000:2.0:1787599523.378751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599523.378790:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543340032 00000100:00100000:0.0:1787599523.378796:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543340032 00000100:00100000:0.0:1787599523.378845:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599523.378853:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543340032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599523.378902:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543340032:12345-0@lo:400:kworker.0 Request processed in 50us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599523.378909:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787599523.380014:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787599523.380053:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f6c466ef480 x1874433543340032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599523.380125:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543340032:0@lo:400:kworker.0 00000100:00100000:3.0:1787599523.388556:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1874433543339776:12345-0@lo:8:kworker.0 Request processed in 17820us (17965us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599523.388572:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787599523.388891:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599523.388898:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787599523.388902:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543339776:0@lo:8:kworker.0 00010000:00010000:1.0:1787599523.489257:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599524.513256:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787599525.387846:0:15803:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787599525.387851:0:15803:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787599525.387954:0:15803:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f6c75999000 00000020:01000004:3.0:1787599525.387969:0:15803:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787599525.387981:0:15803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787599525.387996:0:15803:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f6c483319b8) 00000020:00000080:3.0:1787599525.388012:0:15803:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787599525.402690:0:15803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787599525.403014:0:15803:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787599525.403909:0:15803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787599525.404140:0:15803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787599525.404480:0:15803:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787599525.404914:0:15803:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 465: rc = 0 00100000:10000000:2.0:1787599525.405011:0:15803:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 465: rc = 0 00100000:10000000:2.0:1787599525.405251:0:15803:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 465: rc = 0 00100000:10000000:2.0:1787599525.408851:0:15803:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 647: rc = 0 00100000:10000000:2.0:1787599525.410150:0:15803:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 647: rc = 0 00100000:10000000:2.0:1787599525.412279:0:15803:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 647: rc = 0 00100000:10000000:2.0:1787599525.412966:0:15803:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 647: rc = 0 00100000:10000000:2.0:1787599525.416937:0:15803:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 647: rc = 0 00100000:10000000:2.0:1787599525.417298:0:15803:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 647: rc = 0 00000020:00000080:2.0:1787599525.418375:0:15803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787599525.418387:0:15803:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787599525.418398:0:15803:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa46cbc674118381a 00000020:01000004:2.0:1787599525.418407:0:15803:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787599525.418426:0:15803:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787599525.418429:0:15803:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787599525.418434:0:15803:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787599525.418453:0:15803:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787599525.418457:0:15803:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787599525.430425:0:15803:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787599525.430470:0:15803:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.130@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787599525.430475:0:15803:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787599525.430476:0:15803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787599525.430477:0:15803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599525.430478:0:15803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599525.430479:0:15803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599525.430480:0:15803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599525.430482:0:15803:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599525.430484:0:15803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599525.430485:0:15803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599525.430488:0:15803:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787599525.430490:0:15803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787599525.430492:0:15803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787599525.430493:0:15803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599525.430494:0:15803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599525.430495:0:15803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599525.430496:0:15803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599525.430496:0:15803:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599525.430498:0:15803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599525.430498:0:15803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599525.430524:0:15803:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787599525.430544:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340160:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787599525.430746:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.430818:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5032a300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599525.430963:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543340160 00000100:00100000:0.0:1787599525.430973:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543340160 00000100:00100000:0.0:1787599525.431032:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787599525.431042:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15803:x1874433543340160:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787599525.431075:0:14398:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787599525.431078:0:14398:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787599525.431083:0:14398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787599525.453208:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15803:x1874433543340160:12345-0@lo:253:mount.lustre.0 Request processed in 22158us (22453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599525.453222:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787599525.453590:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340160:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787599525.453605:0:15803:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787599525.453609:0:15803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787599525.453610:0:15803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787599525.453611:0:15803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599525.453612:0:15803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599525.453613:0:15803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599525.453614:0:15803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599525.453616:0:15803:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599525.453618:0:15803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599525.453619:0:15803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787599525.453639:0:15803:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f6c75999000 from lustre-OST0001 10000000:01000000:2.0:1787599525.453666:0:15803:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787599525.453669:0:15803:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787599525.453677:0:15803:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f6c767099b8 local copy 00010000:00010000:2.0:1787599525.453688:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ce expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599525.453954:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599525.453996:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.454025:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5032aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599525.454634:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543340288 00000100:00100000:0.0:1787599525.454643:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543340288 00000100:00100000:0.0:1787599525.454697:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787599525.454706:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15803:x1874433543340288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599525.455012:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15803:x1874433543340288:12345-0@lo:501:mount.lustre.0 Request processed in 307us (1015us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599525.455020:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787599525.456208:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340288:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787599525.456235:0:15803:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787599525.456463:0:15803:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787599525.456473:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ce expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599525.456483:0:15803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c751ffc00/0xa46cbc67411835c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411835ce expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599525.456510:0:15803:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f6c75999000 10000000:01000000:2.0:1787599525.456521:0:15803:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787599525.456990:0:15803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787599525.456995:0:15803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599525.457001:0:15803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787599525.457004:0:15803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787599525.457036:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc6741183821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599525.457045:0:15803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc6741183821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599525.457056:0:15803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc6741183821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599525.457076:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599525.457129:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.457273:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5032aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599525.463961:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543340416 00000100:00100000:3.0:1787599525.463979:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543340416 00000100:00100000:3.0:1787599525.464049:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787599525.464061:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:15803:x1874433543340416:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599525.464077:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599525.464110:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c5b24d800/0xa46cbc6741183828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741183821 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.464137:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c5b24d800/0xa46cbc6741183828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741183821 expref: 17 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.464148:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c5b24d800/0xa46cbc6741183828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741183821 expref: 17 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.464396:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d800, rc 0) 00000100:00100000:1.0:1787599525.464668:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:15803:x1874433543340416:12345-0@lo:101:mount.lustre.0 Request processed in 608us (7536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599525.464730:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787599525.464941:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599525.464963:0:15803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc6741183821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183828 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599525.464974:0:15803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc6741183821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741183828 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599525.466093:0:15803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787599525.467119:0:15803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599525.467535:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787599525.467590:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787599525.467623:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787599525.467904:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787599525.467953:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787599525.467983:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787599525.468040:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787599525.468048:0:15803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787599525.468143:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599525.468237:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.468403:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5032af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599525.468489:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543340544 00000100:00100000:1.0:1787599525.468496:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543340544 00000100:00100000:1.0:1787599525.468543:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599525.468563:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:15803:x1874433543340544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599525.469085:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:15803:x1874433543340544:12345-0@lo:501:mount.lustre.0 Request processed in 532us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599525.469093:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787599525.469195:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599525.469232:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599525.469379:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.469441:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5032af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599525.469471:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543340672 00000100:00100000:1.0:1787599525.469475:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543340672 00000100:00100000:1.0:1787599525.469506:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787599525.469514:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:15803:x1874433543340672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599525.470247:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:15803:x1874433543340672:12345-0@lo:503:mount.lustre.0 Request processed in 730us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599525.470255:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787599525.470416:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340672:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787599525.471087:0:15803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787599525.471255:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599525.471418:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.471486:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5032af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599525.471522:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543340800 00000100:00100000:1.0:1787599525.471528:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543340800 00000100:00100000:1.0:1787599525.471578:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599525.471588:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:15803:x1874433543340800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599525.471865:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:15803:x1874433543340800:12345-0@lo:502:mount.lustre.0 Request processed in 279us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599525.471872:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787599525.471932:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787599525.472150:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787599525.472420:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787599525.472455:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787599525.472496:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787599525.472527:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787599525.472569:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787599525.472637:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787599525.472730:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787599525.472779:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787599525.472945:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599525.472997:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.473074:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5032af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787599525.473112:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543340928 00000100:00100000:1.0:1787599525.473118:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543340928 00000100:00100000:1.0:1787599525.473447:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599525.473459:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:15803:x1874433543340928:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599525.473730:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:15803:x1874433543340928:12345-0@lo:502:mount.lustre.0 Request processed in 273us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599525.473737:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787599525.473941:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543340928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787599525.474019:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787599525.474030:0:15803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787599525.475221:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787599525.475229:0:15805:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787599525.475235:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599525.475237:0:15805:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787599525.475242:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599525.475270:0:15805:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f6b4426b370) 00000020:00000080:3.0:1787599525.475387:0:15805:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787599525.475394:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787599525.475448:0:15805:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6c75999000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787599525.475456:0:15805:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787599525.475462:0:15805:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa46cbc6741183836 00010000:00010000:3.0:1787599525.479788:0:15805:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787599525.480392:0:15805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787599525.482080:0:15805:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787599525.483428:0:15805:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787599525.483438:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599525.483444:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599525.483446:0:15805:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787599525.483450:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599525.483458:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599525.483459:0:15805:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787599525.483463:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787599525.483465:0:15805:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787599525.483467:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599525.483469:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599525.483470:0:15805:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787599525.483472:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599525.483474:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599525.483475:0:15805:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787599525.483478:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787599525.483526:0:15805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599525.483529:0:15805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599525.483530:0:15805:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787599525.483533:0:15805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787599525.483766:0:15803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787599525.483795:0:15803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787599525.483818:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc6741183821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183828 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599525.483830:0:15803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40030000/0xa46cbc6741183821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183828 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599525.483838:0:15803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c75999000 from 1 10000000:01000000:2.0:1787599525.483840:0:15803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599525.483874:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599525.483882:0:15803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599525.483892:0:15803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599525.483914:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599525.483975:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.484091:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5032af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599525.484766:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543341056 00000100:00100000:0.0:1787599525.484774:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543341056 00000100:00100000:0.0:1787599525.485919:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787599525.485935:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:15803:x1874433543341056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599525.485952:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599525.485969:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751fe800/0xa46cbc6741183844 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118383d expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599525.485996:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fe800/0xa46cbc6741183844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118383d expref: 18 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599525.486008:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751fe800/0xa46cbc6741183844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118383d expref: 18 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599525.486017:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fe800, rc 0) 00000100:00100000:0.0:1787599525.486091:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543341056:12345-0@lo:101:mount.lustre.0 Request processed in 162us (2115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599525.486109:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787599525.486224:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599525.486242:0:15803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.486252:0:15803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599525.486772:0:15803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787599525.487059:0:15803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599525.487335:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787599525.487372:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787599525.487426:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787599525.487434:0:15803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787599525.487494:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599525.487540:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599525.487589:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5b3b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599525.487932:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543341184 00000100:00100000:0.0:1787599525.487939:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543341184 00000100:00100000:0.0:1787599525.487986:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787599525.487994:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543341184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599525.488209:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543341184:12345-0@lo:501:mount.lustre.0 Request processed in 215us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599525.488216:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787599525.488269:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599525.488303:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599525.488342:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599525.488365:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543341312 00000100:00100000:0.0:1787599525.488369:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543341312 00000100:00100000:0.0:1787599525.488391:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787599525.488397:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6a294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543341312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599525.488659:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6a294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543341312:12345-0@lo:503:mount.lustre.0 Request processed in 261us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599525.488665:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787599525.489214:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c497e6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599525.489231:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341312:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787599525.489846:0:15803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599525.489914:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599525.489964:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599525.489985:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5b3b9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599525.490048:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543341440 00000100:00100000:1.0:1787599525.490053:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543341440 00000100:00100000:1.0:1787599525.490101:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787599525.490109:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6a295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543341440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599525.490298:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6a295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543341440:12345-0@lo:502:mount.lustre.0 Request processed in 190us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599525.490305:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787599525.491314:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599525.492378:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787599525.492458:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787599525.492517:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787599525.492826:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787599525.492866:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787599525.492911:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787599525.492943:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787599525.492972:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787599525.493013:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599525.493082:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599525.495704:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5b3b9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599525.498279:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543341568 00000100:00100000:0.0:1787599525.498296:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543341568 00000100:00100000:1.0:1787599525.498803:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787599525.498816:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6a295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543341568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599525.499121:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6a295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543341568:12345-0@lo:502:mount.lustre.0 Request processed in 297us (6027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599525.499131:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787599525.499639:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787599525.499882:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787599525.499900:0:15803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787599525.503433:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599525.503449:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599525.503451:0:15809:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787599525.503460:0:15809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6c75999000 00000020:00000080:1.0:1787599525.503463:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599525.503471:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599525.503473:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599525.503474:0:15809:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787599525.503477:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599525.503479:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599525.503480:0:15809:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787599525.503483:0:15809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f6c75999000 00000020:00000080:1.0:1787599525.503485:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599525.503558:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599525.503562:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599525.503564:0:15809:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787599525.503567:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599525.503569:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599525.503571:0:15809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787599525.503574:0:15809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f6c75999000 00000020:00000080:1.0:1787599525.503588:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599525.503629:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599525.503633:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599525.503634:0:15809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787599525.503637:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787599525.508036:0:15803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787599525.508081:0:15803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599525.508339:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599525.508354:0:15803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599525.508735:0:15803:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787599525.508740:0:15803:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f6c75999000 10000000:01000000:1.0:1787599525.508743:0:15803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f6c75999000 10000000:01000000:1.0:1787599525.508748:0:15803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787599525.508755:0:15803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f6c75999000 from 1 10000000:01000000:1.0:1787599525.508757:0:15803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787599525.508794:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde600/0xa46cbc674118384b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599525.508804:0:15803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde600/0xa46cbc674118384b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599525.508815:0:15803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde600/0xa46cbc674118384b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599525.508839:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787599525.508900:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599525.508946:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599525.510935:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543341696 00000100:00100000:0.0:1787599525.510948:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543341696 00000100:00100000:0.0:1787599525.511007:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787599525.511017:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c6a296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543341696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599525.511035:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599525.511054:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741183852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc674118384b expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599525.511083:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741183852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc674118384b expref: 19 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599525.511093:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751ff200/0xa46cbc6741183852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118384b expref: 19 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599525.511102:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff200, rc 0) 00000100:00100000:0.0:1787599525.511193:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c6a296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:15803:x1874433543341696:12345-0@lo:101:mount.lustre.0 Request processed in 177us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599525.511201:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787599525.511793:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599525.511813:0:15803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde600/0xa46cbc674118384b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183852 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599525.511823:0:15803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde600/0xa46cbc674118384b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc6741183852 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599525.512503:0:15803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787599525.515322:0:15803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599525.515631:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787599525.518280:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787599525.518387:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787599525.518456:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787599525.518493:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787599525.518538:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787599525.518590:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787599525.518625:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787599525.519773:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787599525.519853:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787599525.519886:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787599525.519941:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787599525.519975:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787599525.520002:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787599525.520042:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787599525.520071:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787599525.520097:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787599525.520145:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787599525.520208:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787599525.520243:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787599525.520287:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787599525.520322:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787599525.520353:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787599525.520394:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787599525.520423:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787599525.520447:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787599525.520480:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787599525.520506:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787599525.520533:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787599525.520583:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787599525.520615:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787599525.520642:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787599525.522825:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787599525.522925:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787599525.522962:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787599525.523007:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787599525.523046:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787599525.523142:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787599525.523151:0:15803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787599525.524427:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599525.524497:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599525.525485:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599525.525601:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543341824 00000100:00100000:0.0:1787599525.525609:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543341824 00000100:00100000:0.0:1787599525.525823:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787599525.525834:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:15803:x1874433543341824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599525.527047:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75997850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:15803:x1874433543341824:12345-0@lo:501:mount.lustre.0 Request processed in 1211us (2545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599525.527049:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599525.527057:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787599525.527102:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599525.527146:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599525.527256:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b91540 going to sleep for 11 seconds 00000100:00100000:3.0:1787599525.531898:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543341952 00000100:00100000:3.0:1787599525.531914:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543341952 00000100:00100000:3.0:1787599525.531965:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787599525.531976:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:15803:x1874433543341952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599525.532336:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:15803:x1874433543341952:12345-0@lo:503:mount.lustre.0 Request processed in 360us (5187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599525.532344:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787599525.532586:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543341952:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787599525.534955:0:15803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787599525.535051:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543342080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599525.535133:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599525.535193:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c537669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599525.535221:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543342080 00000100:00100000:0.0:1787599525.535227:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543342080 00000100:00100000:0.0:1787599525.535263:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787599525.535272:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:15803:x1874433543342080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599525.535584:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:15803:x1874433543342080:12345-0@lo:502:mount.lustre.0 Request processed in 312us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599525.535592:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787599525.535652:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543342080:0@lo:502:mount.lustre.0 00010000:00010000:2.0:1787599525.538251:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787599525.540216:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787599525.540316:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787599525.540355:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787599525.540404:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787599525.540443:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787599525.540491:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787599525.540530:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787599525.540582:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787599525.540632:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787599525.540669:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787599525.541610:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787599525.541745:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787599525.541793:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787599525.541829:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787599525.541886:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787599525.541928:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787599525.542749:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787599525.542813:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787599525.542845:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787599525.542877:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787599525.542929:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787599525.542962:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787599525.542991:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787599525.543035:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787599525.543065:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787599525.543095:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787599525.543137:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787599525.543194:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787599525.543231:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787599525.543283:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787599525.543319:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787599525.543355:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787599525.543388:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787599525.543428:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787599525.543458:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787599525.543530:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787599525.543743:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787599525.543782:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787599525.543846:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787599525.543886:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787599525.543942:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543342208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599525.544023:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599525.544118:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7f7dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599525.544276:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543342208 00000100:00100000:2.0:1787599525.544284:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543342208 00000100:00100000:2.0:1787599525.544374:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787599525.544385:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:15803:x1874433543342208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599525.544950:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75995850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:15803:x1874433543342208:12345-0@lo:502:mount.lustre.0 Request processed in 566us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599525.544959:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787599525.545037:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543342208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599525.545126:0:15803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787599525.545139:0:15803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787599525.550795:0:15814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787599525.550811:0:15814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f6c76708000) 00000020:00000080:0.0:1787599525.550831:0:15814:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787599525.550892:0:15814:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f6c75999000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787599525.550894:0:15814:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f6c75999000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787599525.550908:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f6c75999000 3 00010000:00080000:0.0:1787599525.550932:0:15814:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f6c6a2a4800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1787599525.553543:0:15814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787599525.554678:0:15814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787599525.554719:0:15814:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787599525.554732:0:15814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa46cbc6741183860 00000100:00080000:0.0:1787599525.554743:0:15814:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787599525.554750:0:15814:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f6c6a2a4800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1787599525.554786:0:15814:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c75deb480 x1874433543342336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787599525.554820:0:15814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787599525.554883:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874433543342336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787599525.554955:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787599525.555048:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599525.555052:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787599525.555055:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599525.555059:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1787599525.555062:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787599525.555065:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f6c7662b000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787599525.555089:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c466ec380 x1874433543342592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599525.555217:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543342464:0@lo:400:kworker.0 00000100:00100000:2.0:1787599525.555248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.555296:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543342720:0@lo:400:kworker.0 00000100:00100000:2.0:1787599525.555321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.555341:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599525.555354:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543342848:0@lo:400:kworker.0 00000100:00100000:2.0:1787599525.555378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.555410:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543342464 00000100:00100000:2.0:1787599525.555417:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543342464 00000100:00100000:2.0:1787599525.555465:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599525.555482:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543342464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599525.555538:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543342464:12345-0@lo:400:kworker.0 Request processed in 58us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599525.555545:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599525.555581:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543342336 00000100:00100000:2.0:1787599525.555588:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543342336 00000100:00100000:2.0:1787599525.555604:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543342720 00000100:00100000:2.0:1787599525.555607:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543342720 00000100:00100000:0.0:1787599525.555622:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543342848 00000100:00100000:0.0:1787599525.555625:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543342848 00000100:00100000:2.0:1787599525.555629:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599525.555635:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543342720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599525.555646:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599525.555652:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543342848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599525.555668:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543342720:12345-0@lo:400:kworker.0 Request processed in 34us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599525.555675:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599525.555687:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599525.555691:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3298:x1874433543342336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787599525.555711:0:15521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1787599525.555749:0:15521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa46cbc6741183867 00000100:00100000:0.0:1787599525.555749:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543342848:12345-0@lo:400:kworker.0 Request processed in 97us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599525.555756:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00100000:2.0:1787599525.555767:0:15521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787599525.555803:0:15521:0:(import.c:65:import_set_state_nolock()) ffff9f6c5808a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599525.555837:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874433543342336:12345-0@lo:38:llog_process_th.0 Request processed in 144us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599525.555843:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787599525.555870:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599525.555874:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599525.555907:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543342464:0@lo:400:kworker.0 00000040:00080000:0.0:1787599525.555918:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:2.0:1787599525.555936:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466ed500 x1874433543342848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599525.555945:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543342848:0@lo:400:kworker.0 00010000:00080000:2.0:1787599525.555953:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466ee680 x1874433543342720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599525.555961:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543342720:0@lo:400:kworker.0 00000100:00100000:2.0:1787599525.555978:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543342592:0@lo:8:kworker.0 00000100:00100000:2.0:1787599525.556000:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787599525.556025:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75deb480 x1874433543342336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599525.556032:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787599525.556038:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787599525.556045:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787599525.556049:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787599525.556051:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c6a2a4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787599525.556057:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874433543342336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787599525.556078:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543342592 00000100:00100000:2.0:1787599525.556081:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543342592 00000100:00100000:2.0:1787599525.556218:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599525.556224:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3298:x1874433543342592:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787599525.556330:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3298:x1874433543342592:12345-0@lo:8:kworker.0 Request processed in 104us (328us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787599525.556342:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599525.557355:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787599525.557363:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599525.557368:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787599525.557372:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543342592:0@lo:8:kworker.0 00000020:01000000:2.0:1787599525.557398:0:15803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787599525.557437:0:15803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787599525.562207:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde600/0xa46cbc674118384b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183852 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599525.562225:0:15803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75dde600/0xa46cbc674118384b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc6741183852 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787599525.562310:0:15803:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787599525.562312:0:15803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787599525.562313:0:15803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599525.562314:0:15803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599525.562315:0:15803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599525.562316:0:15803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599525.562318:0:15803:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599525.562320:0:15803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599525.562321:0:15803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787599525.562325:0:15803:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787599525.562327:0:15803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787599525.562328:0:15803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787599525.562329:0:15803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599525.562330:0:15803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599525.562332:0:15803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599525.562333:0:15803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599525.562334:0:15803:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599525.562335:0:15803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599525.562335:0:15803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787599525.562362:0:15803:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787599525.562387:0:15803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543342976:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787599525.562458:0:15803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599525.563133:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543342976 00000100:00100000:2.0:1787599525.563143:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543342976 00000100:00100000:2.0:1787599525.563559:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787599525.563571:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:15803:x1874433543342976:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787599525.563602:0:14400:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787599525.563616:0:14400:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787599525.564046:0:15803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c518426c0 going to sleep for 11 seconds 20000000:01000000:2.0:1787599525.617418:0:14400:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787599525.617442:0:14400:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787599525.619131:0:14421:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787599525.619140:0:14421:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787599525.619183:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599525.619205:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c75ddee00/0xa46cbc6741183748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741183741 expref: 19 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599525.619215:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599525.619276:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c75ddee00/0xa46cbc6741183748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741183741 expref: 19 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599525.619314:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c75ddee00/0xa46cbc6741183748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741183741 expref: 19 pid: 14399 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599525.619330:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76122680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14421:1874433543343104:0@lo:104: 00000100:00100000:1.0:1787599525.619401:0:14421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599525.619456:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c58b919c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599525.619528:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543343104 00000100:00100000:3.0:1787599525.619536:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543343104 00000100:00100000:3.0:1787599525.619599:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599525.619609:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+3:14421:x1874433543343104:12345-0@lo:104: 00010000:00010000:3.0:1787599525.619622:0:14388:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.619677:0:14388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787599525.619683:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+3:14421:x1874433543343104:12345-0@lo:104: Request processed in 76us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599525.619690:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787599525.619711:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599525.619717:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.619725:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf600 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599525.619729:0:14393:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.619738:0:14393:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599525.619756:0:14393:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599525.619762:0:14393:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787599525.619789:0:14393:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.619796:0:14393:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599525.619816:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.619836:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf600/0xa46cbc6741183741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183748 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.619851:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599525.619853:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599525.619855:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599525.619875:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3301:1874433543343232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599525.619905:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599525.619943:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543343232 00000100:00100000:3.0:1787599525.619947:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543343232 00010000:00010000:3.0:1787599525.619964:0:14391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c75ddee00/0xa46cbc6741183748 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741183741 expref: 20 pid: 14399 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599525.619986:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599525.619992:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+20:3301:x1874433543343232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599525.620003:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599525.620008:0:14391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c75ddee00/0xa46cbc6741183748 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741183741 expref: 20 pid: 14399 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620025:0:14391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c75ddee00/0xa46cbc6741183748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741183741 expref: 20 pid: 14399 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620042:0:14391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620050:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787599525.620063:0:14391:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002531080s 00010000:00010000:3.0:1787599525.620067:0:14391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620075:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620082:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620089:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620095:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddec00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599525.620100:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620108:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620116:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620132:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599525.620196:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+20:3301:x1874433543343232:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599525.620203:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599525.620237:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3301:1874433543343232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599525.620262:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75ddee00/0xa46cbc6741183748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741183741 expref: 19 pid: 14399 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599525.620271:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76122680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14421:1874433543343104:0@lo:104: 00010000:00010000:3.0:1787599525.620285:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620294:0:14421:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620300:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599525.620306:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75ddec00/0xa46cbc674118386e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599525.625095:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:15803:x1874433543342976:12345-0@lo:253:mount.lustre.0 Request processed in 61517us (62627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599525.625110:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787599525.625513:0:15803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2ecb12f6-efb3-4b22-8787-68be26cc19d4:15803:1874433543342976:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787599525.625531:0:15803:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787599525.625534:0:15803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787599525.625536:0:15803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787599525.625537:0:15803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599525.625538:0:15803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599525.625539:0:15803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599525.625540:0:15803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599525.625541:0:15803:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599525.625543:0:15803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599525.625545:0:15803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787599525.625571:0:15803:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787599525.635341:0:15803:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787599525.635516:0:15803:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787599525.635978:0:15803:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787599525.636198:0:15803:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787599525.636359:0:15803:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787599525.636602:0:15803:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787599525.638087:0:15803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787599525.689630:0:15803:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787599525.689639:0:15803:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787599525.689676:0:15803:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787599525.689733:0:15803:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787599525.689746:0:15803:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787599525.689773:0:15803:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000040:00080000:0.0:1787599525.922189:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787599526.568231:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787599527.329293:0:14402:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787599527.329302:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f6b45127800 from 8 10000000:01000000:3.0:1787599527.329307:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787599527.329350:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc6741183875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599527.329363:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc6741183875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599527.329375:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc6741183875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599527.329401:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543343360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599527.329466:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599527.329524:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4819db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599527.329596:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543343360 00000100:00100000:0.0:1787599527.329665:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543343360 00000100:00100000:0.0:1787599527.330194:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787599527.330205:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:14402:x1874433543343360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599527.330219:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599527.330241:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751fec00/0xa46cbc674118387c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc6741183875 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599527.330264:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fec00/0xa46cbc674118387c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc6741183875 expref: 19 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599527.330275:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751fec00/0xa46cbc674118387c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741183875 expref: 19 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599527.330284:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fec00, rc 0) 00000100:00100000:0.0:1787599527.330340:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:14402:x1874433543343360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599527.330347:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787599527.330428:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543343360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599527.330443:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc6741183875 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118387c expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599527.330452:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc6741183875 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc674118387c expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599527.330500:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543343488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787599527.330544:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599527.331785:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4819db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599527.335267:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543343488 00000100:00100000:1.0:1787599527.335285:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543343488 00000100:00100000:1.0:1787599527.335345:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787599527.335356:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:14402:x1874433543343488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787599527.335382:0:14398:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787599527.335405:0:14398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787599527.335409:0:14398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787599527.335561:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:14402:x1874433543343488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 206us (5015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599527.335571:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787599527.335577:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543343488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787599527.335647:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787599527.335657:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc6741183875 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118387c expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599527.335674:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24de00/0xa46cbc6741183875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc674118387c expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599527.587786:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599528.489467:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599528.489490:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543343616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599528.489577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599528.490243:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543343616 00000100:00100000:0.0:1787599528.490253:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543343616 00000100:00100000:0.0:1787599528.490329:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599528.490345:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543343616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599528.490393:0:15092:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787599528.490456:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543343616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599528.490463:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599528.490526:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543343616:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787599528.490643:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787599528.611619:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599529.635385:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599530.661477:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599531.043933:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599531.043940:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787599531.043943:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599531.043955:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f6c7662b000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1787599531.043974:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f6c466ece00 x1874433543344000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599531.044027:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543343872:0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.044101:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599531.044148:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787599531.044153:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3300:1874433543343744:0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.044195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599531.044214:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543344384:0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.044235:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599531.044257:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543344000:0@lo:8:kworker.0 00000100:00100000:2.0:1787599531.044277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599531.044299:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543344128:0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.044317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599531.044332:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599531.044336:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543344256:0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.044352:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599531.044375:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543343872 00000100:00100000:2.0:1787599531.044382:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543343872 00000100:00100000:2.0:1787599531.044427:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543344000 00000100:00100000:2.0:1787599531.044430:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543344000 00000100:00100000:2.0:1787599531.044454:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599531.044464:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543343872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.044524:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543343872:12345-0@lo:400:kworker.0 Request processed in 63us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599531.044532:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599531.044550:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599531.044554:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1874433543344000:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787599531.044795:0:15088:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1787599531.044822:0:15088:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa46cbc6741183883 00002000:00100000:2.0:1787599531.044834:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f6c5808b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787599531.044838:0:15088:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787599531.044840:0:15088:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787599531.045248:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787599531.045273:0:15088:0:(import.c:65:import_set_state_nolock()) ffff9f6c5808f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599531.045315:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1874433543344000:12345-0@lo:8:kworker.0 Request processed in 758us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599531.045322:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599531.045345:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543343744 00000100:00100000:2.0:1787599531.045349:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543343744 00000100:00100000:2.0:1787599531.045373:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787599531.045380:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3300:x1874433543343744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.045407:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3300:x1874433543343744:12345-0@lo:400:kworker.0 Request processed in 28us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599531.045412:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787599531.045438:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543344384 00000100:00100000:2.0:1787599531.045441:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543344384 00000100:00100000:2.0:1787599531.045478:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543344128 00000100:00100000:2.0:1787599531.045481:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543344128 00000100:00100000:2.0:1787599531.045500:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543344256 00000100:00100000:2.0:1787599531.045502:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543344256 00000100:00100000:2.0:1787599531.045514:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599531.045519:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543344384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.045547:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874433543344384:12345-0@lo:400:kworker.0 Request processed in 28us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599531.045553:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599531.045562:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599531.045757:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543344128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.045803:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543344128:12345-0@lo:400:kworker.0 Request processed in 235us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599531.045810:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599531.045822:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599531.045828:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543344256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.045854:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543344256:12345-0@lo:400:kworker.0 Request processed in 27us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599531.045860:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787599531.045884:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599531.045887:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787599531.045921:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466ece00 x1874433543344000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787599531.045938:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787599531.045944:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787599531.045949:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787599531.045951:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9f6c7662b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787599531.045974:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787599531.045981:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874433543344000:0@lo:8:kworker.0 00010000:00080000:2.0:1787599531.046026:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466ef480 x1874433543344256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599531.046035:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543344256:0@lo:400:kworker.0 00010000:00080000:2.0:1787599531.046044:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466efb80 x1874433543344128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599531.046139:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543344128:0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.046188:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3300:1874433543343744:0@lo:400:kworker.0 00010000:00080000:2.0:1787599531.046197:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c466eed80 x1874433543344384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599531.046205:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874433543344384:0@lo:400:kworker.0 00000100:00100000:2.0:1787599531.046215:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c466ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543343872:0@lo:400:kworker.0 00000004:00080000:1.0:1787599531.046362:0:14430:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787599531.046381:0:14430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14430:1874433543344640:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787599531.046422:0:14430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599531.046453:0:14430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7660a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599531.046463:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599531.046471:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543344512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599531.046494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599531.046529:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543344512 00000100:00100000:1.0:1787599531.046534:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543344512 00000100:00080000:0.0:1787599531.046583:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599531.046585:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599531.046595:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874433543344512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599531.046618:0:15092:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599531.046663:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874433543344512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599531.046670:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599531.046692:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543344640 00000100:00100000:1.0:1787599531.046696:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543344640 00010000:00080000:0.0:1787599531.046708:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c76121880 x1874433543344512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599531.046723:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599531.046724:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543344512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599531.046730:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14430:x1874433543344640:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787599531.046950:0:14429:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787599531.048044:0:14429:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 488421885786ns, next at 0ns, rc = 0 00002000:00080000:1.0:1787599531.049134:0:15088:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787599531.049143:0:15088:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787599531.049148:0:15088:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1787599531.082037:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.082050:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92764c8/0xa46cbc674118388a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.082067:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.082072:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.082078:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92764c8/0xa46cbc674118388a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.082096:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92764c8/0xa46cbc674118388a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.082106:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92764c8/0xa46cbc674118388a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.082120:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92764c8/0xa46cbc674118388a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.082138:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599531.082787:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.082794:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c06891cc/0xa46cbc6741183891 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.082803:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.082806:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.082810:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c06891cc/0xa46cbc6741183891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.082820:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c06891cc/0xa46cbc6741183891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.082828:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c06891cc/0xa46cbc6741183891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.082834:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c06891cc/0xa46cbc6741183891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.082847:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787599531.083773:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599531.083782:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92764c8/0xa46cbc674118388a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.083791:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75dde800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.083795:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92764c8/0xa46cbc674118388a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.083804:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92764c8/0xa46cbc674118388a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.083825:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92764c8/0xa46cbc674118388a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.083837:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92764c8/0xa46cbc674118388a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.083856:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599531.083860:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c06891cc/0xa46cbc6741183891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.083865:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.083868:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c06891cc/0xa46cbc6741183891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.083875:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c06891cc/0xa46cbc6741183891 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.083885:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c06891cc/0xa46cbc6741183891 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.083891:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c06891cc/0xa46cbc6741183891 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.083902:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.083904:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.083905:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.088146:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.088175:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9606f2f/0xa46cbc6741183898 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.088198:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.088203:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.088209:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9606f2f/0xa46cbc6741183898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.088224:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9606f2f/0xa46cbc6741183898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.088236:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9606f2f/0xa46cbc6741183898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.088258:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9606f2f/0xa46cbc6741183898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.088278:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599531.088829:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.088837:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcb9d060/0xa46cbc674118389f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.088846:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.088849:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.088853:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb9d060/0xa46cbc674118389f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.088863:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcb9d060/0xa46cbc674118389f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.088882:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcb9d060/0xa46cbc674118389f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.088890:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb9d060/0xa46cbc674118389f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.088898:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787599531.089309:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.089315:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006f935e9/0xa46cbc67411838a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.089324:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.089327:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.089331:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006f935e9/0xa46cbc67411838a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.089341:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006f935e9/0xa46cbc67411838a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.089349:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006f935e9/0xa46cbc67411838a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.089355:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006f935e9/0xa46cbc67411838a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089372:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599531.089373:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787599531.089379:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9606f2f/0xa46cbc6741183898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089387:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75dde400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.089391:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9606f2f/0xa46cbc6741183898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089401:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9606f2f/0xa46cbc6741183898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089420:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9606f2f/0xa46cbc6741183898 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089428:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9606f2f/0xa46cbc6741183898 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089459:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599531.089468:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcb9d060/0xa46cbc674118389f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089475:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddec00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.089478:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb9d060/0xa46cbc674118389f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089487:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb9d060/0xa46cbc674118389f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089498:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcb9d060/0xa46cbc674118389f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089505:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcb9d060/0xa46cbc674118389f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089516:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599531.089520:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006f935e9/0xa46cbc67411838a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089526:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddee00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.089529:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006f935e9/0xa46cbc67411838a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089537:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006f935e9/0xa46cbc67411838a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089558:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006f935e9/0xa46cbc67411838a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089564:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006f935e9/0xa46cbc67411838a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599531.089794:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.089800:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9638f4/0xa46cbc67411838ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.089809:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.089812:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.089816:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9638f4/0xa46cbc67411838ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.089825:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea9638f4/0xa46cbc67411838ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.089834:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9638f4/0xa46cbc67411838ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.089841:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9638f4/0xa46cbc67411838ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.089850:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599531.089928:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599531.089932:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea9638f4/0xa46cbc67411838ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089939:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.089942:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9638f4/0xa46cbc67411838ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089951:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9638f4/0xa46cbc67411838ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089961:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea9638f4/0xa46cbc67411838ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089969:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea9638f4/0xa46cbc67411838ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.089980:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.089982:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.089988:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.090247:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.090253:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007571bd02/0xa46cbc67411838b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.090260:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1787599531.090265:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.090270:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.090275:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007571bd02/0xa46cbc67411838b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.090284:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007571bd02/0xa46cbc67411838b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.090291:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007571bd02/0xa46cbc67411838b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.090298:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007571bd02/0xa46cbc67411838b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.090320:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599531.090366:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599531.090372:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007571bd02/0xa46cbc67411838b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.090380:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddfc00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.090383:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007571bd02/0xa46cbc67411838b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.090390:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007571bd02/0xa46cbc67411838b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.090401:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007571bd02/0xa46cbc67411838b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.090409:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007571bd02/0xa46cbc67411838b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.090421:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.090423:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.090425:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.090723:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.090729:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090dc4e2d/0xa46cbc67411838bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.090737:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.090739:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.090743:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090dc4e2d/0xa46cbc67411838bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.090752:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090dc4e2d/0xa46cbc67411838bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.090761:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090dc4e2d/0xa46cbc67411838bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.090774:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090dc4e2d/0xa46cbc67411838bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.090794:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599531.090831:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599531.090837:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090dc4e2d/0xa46cbc67411838bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.090845:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.090849:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090dc4e2d/0xa46cbc67411838bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.090863:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090dc4e2d/0xa46cbc67411838bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.090874:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090dc4e2d/0xa46cbc67411838bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.090881:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090dc4e2d/0xa46cbc67411838bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.090895:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.090897:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.090899:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.093050:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.093061:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a6bf5a7/0xa46cbc67411838c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.093075:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.093079:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.093085:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a6bf5a7/0xa46cbc67411838c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.093098:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a6bf5a7/0xa46cbc67411838c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.093107:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a6bf5a7/0xa46cbc67411838c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.093115:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a6bf5a7/0xa46cbc67411838c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.093136:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599531.093151:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599531.093180:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a6bf5a7/0xa46cbc67411838c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.093195:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddfa00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599531.093200:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a6bf5a7/0xa46cbc67411838c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.093208:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a6bf5a7/0xa46cbc67411838c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.093224:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a6bf5a7/0xa46cbc67411838c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.093231:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a6bf5a7/0xa46cbc67411838c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.093745:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.093749:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.093751:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.094550:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.094558:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053052884/0xa46cbc67411838c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.094570:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.094574:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.094579:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053052884/0xa46cbc67411838c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.094590:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053052884/0xa46cbc67411838c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.094605:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053052884/0xa46cbc67411838c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.094613:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053052884/0xa46cbc67411838c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.094715:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599531.095219:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.095225:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af753c4/0xa46cbc67411838d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.095234:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1787599531.095262:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599531.095268:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053052884/0xa46cbc67411838c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.095276:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75dde000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.095281:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053052884/0xa46cbc67411838c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.095288:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053052884/0xa46cbc67411838c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.095305:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053052884/0xa46cbc67411838c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.095323:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053052884/0xa46cbc67411838c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.095340:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.095342:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.095344:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.095355:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.095361:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af753c4/0xa46cbc67411838d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.095371:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005af753c4/0xa46cbc67411838d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.095378:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af753c4/0xa46cbc67411838d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.095385:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005af753c4/0xa46cbc67411838d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.095484:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599531.095493:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599531.095498:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005af753c4/0xa46cbc67411838d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.095504:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599531.095507:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005af753c4/0xa46cbc67411838d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.095515:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005af753c4/0xa46cbc67411838d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.095525:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005af753c4/0xa46cbc67411838d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.095532:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005af753c4/0xa46cbc67411838d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.095543:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.095545:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.095546:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.097291:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.097301:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af35b8b/0xa46cbc67411838d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097313:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.097323:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.097328:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af35b8b/0xa46cbc67411838d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097342:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003af35b8b/0xa46cbc67411838d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097351:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af35b8b/0xa46cbc67411838d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097358:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003af35b8b/0xa46cbc67411838d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097381:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599531.097830:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599531.097836:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003af35b8b/0xa46cbc67411838d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.097845:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75dde200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.097849:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003af35b8b/0xa46cbc67411838d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.097857:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003af35b8b/0xa46cbc67411838d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.097872:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003af35b8b/0xa46cbc67411838d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.097880:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003af35b8b/0xa46cbc67411838d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599531.097887:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.097891:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ee3472/0xa46cbc67411838de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.097896:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.097898:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.097899:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1787599531.097900:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.097902:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.097906:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ee3472/0xa46cbc67411838de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097915:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045ee3472/0xa46cbc67411838de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097923:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ee3472/0xa46cbc67411838de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097934:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045ee3472/0xa46cbc67411838de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097949:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599531.097958:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599531.097962:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045ee3472/0xa46cbc67411838de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097969:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddfe00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599531.097972:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ee3472/0xa46cbc67411838de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097980:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ee3472/0xa46cbc67411838de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097991:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045ee3472/0xa46cbc67411838de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.097997:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045ee3472/0xa46cbc67411838de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098010:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.098012:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.098013:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.098434:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.098458:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bce31f79/0xa46cbc67411838e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098467:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.098470:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.098474:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bce31f79/0xa46cbc67411838e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098483:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bce31f79/0xa46cbc67411838e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098491:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bce31f79/0xa46cbc67411838e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098497:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bce31f79/0xa46cbc67411838e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098512:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599531.098666:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599531.098671:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bce31f79/0xa46cbc67411838e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.098679:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.098682:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bce31f79/0xa46cbc67411838e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.098690:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bce31f79/0xa46cbc67411838e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.098701:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bce31f79/0xa46cbc67411838e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.098708:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bce31f79/0xa46cbc67411838e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.098734:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.098736:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.098738:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.098905:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.098911:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce5611bc/0xa46cbc67411838ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098919:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.098922:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.098926:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce5611bc/0xa46cbc67411838ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098934:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce5611bc/0xa46cbc67411838ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098947:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce5611bc/0xa46cbc67411838ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098954:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce5611bc/0xa46cbc67411838ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.098976:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599531.099393:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.099399:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e42e770/0xa46cbc67411838f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099407:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.099410:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.099414:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e42e770/0xa46cbc67411838f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099422:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e42e770/0xa46cbc67411838f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099430:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e42e770/0xa46cbc67411838f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099437:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e42e770/0xa46cbc67411838f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099471:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787599531.099668:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599531.099673:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce5611bc/0xa46cbc67411838ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099681:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6e00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.099684:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce5611bc/0xa46cbc67411838ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099702:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce5611bc/0xa46cbc67411838ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099836:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce5611bc/0xa46cbc67411838ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099845:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce5611bc/0xa46cbc67411838ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099860:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1787599531.099860:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787599531.099864:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e42e770/0xa46cbc67411838f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099865:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f998fe/0xa46cbc67411838fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099871:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.099874:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e42e770/0xa46cbc67411838f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099874:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.099877:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.099881:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f998fe/0xa46cbc67411838fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099883:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e42e770/0xa46cbc67411838f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099891:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0f998fe/0xa46cbc67411838fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099894:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e42e770/0xa46cbc67411838f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099899:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f998fe/0xa46cbc67411838fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099901:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e42e770/0xa46cbc67411838f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099907:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f998fe/0xa46cbc67411838fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.099914:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599531.099924:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599531.099927:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0f998fe/0xa46cbc67411838fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099934:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6200 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.099937:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f998fe/0xa46cbc67411838fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099945:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f998fe/0xa46cbc67411838fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099955:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0f998fe/0xa46cbc67411838fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099962:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0f998fe/0xa46cbc67411838fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.099973:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.099975:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.099976:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.099984:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.100307:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.100313:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007614b863/0xa46cbc6741183901 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.100321:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.100329:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.100333:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007614b863/0xa46cbc6741183901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.100342:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007614b863/0xa46cbc6741183901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.100350:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007614b863/0xa46cbc6741183901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.100358:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007614b863/0xa46cbc6741183901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.100370:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599531.101936:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.101946:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161552fd/0xa46cbc6741183908 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.101959:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.101962:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.101968:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000161552fd/0xa46cbc6741183908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.101980:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000161552fd/0xa46cbc6741183908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.101990:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161552fd/0xa46cbc6741183908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.102003:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000161552fd/0xa46cbc6741183908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.102018:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787599531.102694:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599531.102703:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007614b863/0xa46cbc6741183901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.102712:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.102723:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007614b863/0xa46cbc6741183901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.102732:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007614b863/0xa46cbc6741183901 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.102747:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007614b863/0xa46cbc6741183901 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.102767:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007614b863/0xa46cbc6741183901 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.102785:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599531.102788:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000161552fd/0xa46cbc6741183908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.102794:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7c00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599531.102797:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000161552fd/0xa46cbc6741183908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.102803:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000161552fd/0xa46cbc6741183908 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.102812:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000161552fd/0xa46cbc6741183908 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.102818:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000161552fd/0xa46cbc6741183908 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599531.102837:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.102839:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.102841:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599531.102847:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.109999:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.110011:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c2072bf/0xa46cbc674118390f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.110026:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.110031:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.110036:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c2072bf/0xa46cbc674118390f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.110052:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c2072bf/0xa46cbc674118390f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.110063:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c2072bf/0xa46cbc674118390f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.110071:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c2072bf/0xa46cbc674118390f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.110089:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599531.110874:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.110881:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032a7d042/0xa46cbc6741183916 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.110897:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.110901:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.110906:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032a7d042/0xa46cbc6741183916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.110917:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032a7d042/0xa46cbc6741183916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.110938:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032a7d042/0xa46cbc6741183916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.110946:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032a7d042/0xa46cbc6741183916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.110963:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787599531.111389:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.111473:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a21250/0xa46cbc674118391d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.111483:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.111487:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.111492:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a21250/0xa46cbc674118391d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.111501:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080a21250/0xa46cbc674118391d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.111521:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a21250/0xa46cbc674118391d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.111529:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080a21250/0xa46cbc674118391d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.111538:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787599531.111886:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.111892:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d65d4eb0/0xa46cbc6741183924 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.111900:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.111903:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.111907:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d65d4eb0/0xa46cbc6741183924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.111915:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d65d4eb0/0xa46cbc6741183924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.111922:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d65d4eb0/0xa46cbc6741183924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.111929:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d65d4eb0/0xa46cbc6741183924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.111946:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787599531.112267:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787599531.112275:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c2072bf/0xa46cbc674118390f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112288:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.112362:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c2072bf/0xa46cbc674118390f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112374:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c2072bf/0xa46cbc674118390f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599531.112388:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787599531.112392:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c2072bf/0xa46cbc674118390f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.112393:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc674118392b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112399:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c2072bf/0xa46cbc674118390f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112419:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787599531.112423:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032a7d042/0xa46cbc6741183916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112429:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.112432:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032a7d042/0xa46cbc6741183916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112440:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032a7d042/0xa46cbc6741183916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112461:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032a7d042/0xa46cbc6741183916 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112476:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032a7d042/0xa46cbc6741183916 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112490:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599531.112493:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080a21250/0xa46cbc674118391d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112499:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.112502:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a21250/0xa46cbc674118391d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112509:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a21250/0xa46cbc674118391d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112517:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080a21250/0xa46cbc674118391d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112524:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080a21250/0xa46cbc674118391d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112535:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599531.112538:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d65d4eb0/0xa46cbc6741183924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112544:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6a00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.112553:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d65d4eb0/0xa46cbc6741183924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.112560:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d65d4eb0/0xa46cbc6741183924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.112847:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.112851:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.112856:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc674118392b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.112865:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc674118392b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.112872:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc674118392b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.112879:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc674118392b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.112887:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599531.113012:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d65d4eb0/0xa46cbc6741183924 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.113021:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d65d4eb0/0xa46cbc6741183924 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.113034:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599531.113037:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc674118392b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.113043:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.113379:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc674118392b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.113388:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc674118392b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.113399:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc674118392b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.113405:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc674118392b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.113426:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.113428:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.113430:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.113779:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.113785:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c61bb67/0xa46cbc6741183932 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.113793:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.113802:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.113807:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c61bb67/0xa46cbc6741183932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.113816:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c61bb67/0xa46cbc6741183932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.113825:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c61bb67/0xa46cbc6741183932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.113832:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c61bb67/0xa46cbc6741183932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.113853:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599531.114267:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.114273:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d1809e/0xa46cbc6741183939 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.114281:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.114284:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.114288:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d1809e/0xa46cbc6741183939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.114297:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d1809e/0xa46cbc6741183939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.114305:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d1809e/0xa46cbc6741183939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.114318:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051d1809e/0xa46cbc6741183939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.114326:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787599531.114387:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599531.114392:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c61bb67/0xa46cbc6741183932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.114400:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6800 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.114404:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c61bb67/0xa46cbc6741183932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.114412:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c61bb67/0xa46cbc6741183932 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.114423:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c61bb67/0xa46cbc6741183932 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.114430:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c61bb67/0xa46cbc6741183932 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.114453:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599531.114457:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051d1809e/0xa46cbc6741183939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.114463:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7a00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.114473:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d1809e/0xa46cbc6741183939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.114480:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d1809e/0xa46cbc6741183939 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.114491:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051d1809e/0xa46cbc6741183939 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.114498:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d1809e/0xa46cbc6741183939 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.114511:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.114513:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.114515:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599531.114831:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.114837:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183940 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.114845:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.114849:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.114853:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.114861:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.114868:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.114875:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.114897:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599531.115373:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787599531.115379:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183947 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.115393:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1787599531.115396:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599531.115400:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.115680:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599531.115686:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.115694:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6c00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.115697:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.115706:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.115729:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183940 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.115744:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183940 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.115821:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.115824:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.115826:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.116282:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599531.116499:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.116508:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.116515:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599531.116528:0:15088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787599531.116760:0:15088:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:2.0:1787599531.116841:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599531.116846:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599531.116849:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14430:x1874433543344640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 70116us (70423us total) trans 0 rc 0/0 00010000:00010000:2.0:1787599531.116854:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:2.0:1787599531.116858:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599531.116859:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787599531.116865:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.116877:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183947 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.116883:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183947 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599531.116897:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.116899:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599531.116906:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599531.116910:0:14430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14430:1874433543344640:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787599531.116926:0:14430:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787599531.116968:0:14430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14430:1874433543344768:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787599531.117002:0:14430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599531.117039:0:14430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48af7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787599531.117059:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543344768 00000100:00100000:1.0:1787599531.117065:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543344768 00000100:00100000:1.0:1787599531.117105:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599531.117114:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14430:x1874433543344768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787599531.117148:0:15091:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1787599531.138090:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14430:x1874433543344768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20970us (21081us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787599531.138103:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787599531.138235:0:14430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14430:1874433543344768:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787599531.138249:0:14430:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:0.0:1787599531.139884:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787599531.682663:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599532.705514:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787599533.122974:0:16161:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787599533.602639:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543344896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599533.602747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599533.603179:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543344896 00000100:00100000:1.0:1787599533.603191:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543344896 00000100:00100000:1.0:1787599533.603269:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599533.603281:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543344896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599533.603327:0:15093:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599533.603390:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543344896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599533.603408:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787599533.604774:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599533.604858:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543344896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787599533.731444:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599534.754252:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787599535.142023:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787599535.643904:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599535.644514:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522377728 00000100:00100000:2.0:1787599535.644525:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522377728 00000100:00100000:2.0:1787599535.644578:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:2.0:1787599535.644587:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1874433522377728:12345-192.168.204.30@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787599535.644614:0:14400:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e4860911-c292-444e-84ed-512edcaae1da@192.168.204.30@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:2.0:1787599535.644645:0:14400:0:(genops.c:1385:class_connect()) connect: client e4860911-c292-444e-84ed-512edcaae1da, cookie 0xa46cbc674118394e 00000100:00080000:2.0:1787599535.644792:0:14400:0:(import.c:65:import_set_state_nolock()) ffff9f6c7599e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599535.644867:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+5:2355:x1874433522377728:12345-192.168.204.30@tcp:250:mount.lustre.0 Request processed in 279us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599535.644876:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:1.0:1787599535.648764:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599535.649589:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522377856 00000100:00100000:2.0:1787599535.649601:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522377856 00000100:00100000:2.0:1787599535.649760:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:2.0:1787599535.649773:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+5:13774:x1874433522377856:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599535.649790:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599535.649809:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741183955 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0756b expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599535.649840:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741183955 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0756b expref: 6 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599535.649868:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40030a00/0xa46cbc6741183955 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0756b expref: 6 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599535.649879:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030a00, rc 0) 00000100:00100000:2.0:1787599535.649959:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+6:13774:x1874433522377856:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 188us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599535.649966:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:3.0:1787599535.652734:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599535.670116:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522377984 00000100:00100000:0.0:1787599535.670134:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522377984 00000100:00100000:0.0:1787599535.670207:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:0.0:1787599535.670219:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+6:13774:x1874433522377984:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787599535.671064:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+6:13774:x1874433522377984:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 843us (18333us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599535.671075:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:1.0:1787599535.687555:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599535.687661:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522378112 00000100:00100000:0.0:1787599535.687670:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522378112 00000100:00100000:0.0:1787599535.687737:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:0.0:1787599535.687749:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+6:13774:x1874433522378112:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787599535.687768:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599535.687788:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118395c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07572 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599535.687817:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118395c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07572 expref: 7 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599535.688032:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751ff600/0xa46cbc674118395c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07572 expref: 7 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599535.688045:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff600, rc 0) 00000100:00100000:0.0:1787599535.688106:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+7:13774:x1874433522378112:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 360us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599535.688129:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:3.0:1787599535.697716:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599535.697784:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522378240 00000100:00100000:2.0:1787599535.697796:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522378240 00000100:00100000:2.0:1787599535.697858:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:2.0:1787599535.697870:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+7:13774:x1874433522378240:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787599535.698209:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+8:13774:x1874433522378240:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 340us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599535.698218:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 80 00000100:00100000:3.0:1787599535.708848:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599535.708977:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522378368 00000100:00100000:1.0:1787599535.708986:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522378368 00000100:00100000:1.0:1787599535.709043:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:1.0:1787599535.709053:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+8:13774:x1874433522378368:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787599535.709313:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+8:13774:x1874433522378368:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 261us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599535.709328:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 81 00000100:00100000:1.0:1787599535.733125:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599535.733596:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522378496 00000100:00100000:0.0:1787599535.733606:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522378496 00000100:00100000:0.0:1787599535.733735:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 82 00000100:00100000:0.0:1787599535.733748:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+8:13793:x1874433522378496:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787599535.734050:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+8:13793:x1874433522378496:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 304us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599535.734058:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 82 00000100:00100000:1.0:1787599535.783972:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:0.0:1787599535.784122:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599535.785282:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522378624 00000100:00100000:2.0:1787599535.785296:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522378624 00000100:00100000:2.0:1787599535.785349:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 83 00000100:00100000:2.0:1787599535.785370:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+8:13793:x1874433522378624:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599535.786610:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+8:13793:x1874433522378624:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 1236us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599535.786622:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 83 00000100:00100000:3.0:1787599535.812956:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599535.813072:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522378752 00000100:00100000:1.0:1787599535.813082:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522378752 00000100:00100000:1.0:1787599535.813144:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:1.0:1787599535.813198:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+8:13774:x1874433522378752:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787599535.813216:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599535.813234:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6b442c6200/0xa46cbc6741183963 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0759c expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599535.813273:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6b442c6200/0xa46cbc6741183963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0759c expref: 9 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599535.813285:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6b442c6200/0xa46cbc6741183963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0759c expref: 9 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599535.813294:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6b442c6200, rc 0) 00000100:00100000:1.0:1787599535.813372:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+9:13774:x1874433522378752:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 219us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599535.813380:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 84 00000100:00100000:0.0:1787599535.830072:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599535.833271:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522378880 00000100:00100000:2.0:1787599535.833287:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522378880 00000100:00100000:2.0:1787599535.833368:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:2.0:1787599535.833380:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+9:13774:x1874433522378880:12345-192.168.204.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787599535.833418:0:14399:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787599535.833447:0:14399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787599535.833451:0:14399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787599535.833454:0:14399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787599535.833456:0:14399:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787599535.849037:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+9:13774:x1874433522378880:12345-192.168.204.30@tcp:256:mount.lustre.0 Request processed in 15646us (18964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599535.849054:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 85 00000100:00100000:3.0:1787599535.860924:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599535.861106:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522379008 00000100:00100000:0.0:1787599535.861118:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522379008 00000100:00100000:0.0:1787599535.861226:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:0.0:1787599535.861238:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+9:13774:x1874433522379008:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787599535.861255:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599535.861277:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751fea00/0xa46cbc674118396a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e075a3 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599535.861307:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751fea00/0xa46cbc674118396a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075a3 expref: 10 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599535.861318:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751fea00/0xa46cbc674118396a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075a3 expref: 10 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599535.861329:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751fea00, rc 0) 00000100:00100000:0.0:1787599535.861408:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+10:13774:x1874433522379008:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 173us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599535.861439:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:3.0:1787599535.866616:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599535.866928:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522379136 00000100:00100000:2.0:1787599535.866938:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522379136 00000100:00100000:2.0:1787599535.866998:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:2.0:1787599535.867008:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+10:13774:x1874433522379136:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787599535.867850:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+10:13774:x1874433522379136:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 840us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599535.867860:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:3.0:1787599535.872572:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599535.872905:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522379264 00000100:00100000:1.0:1787599535.872916:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522379264 00000100:00100000:1.0:1787599535.872976:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:1.0:1787599535.872987:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+10:13774:x1874433522379264:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787599535.873253:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+10:13774:x1874433522379264:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 268us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599535.873268:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:3.0:1787599535.878504:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599535.878589:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522379392 00000100:00100000:0.0:1787599535.878601:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522379392 00000100:00100000:0.0:1787599535.878662:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:0.0:1787599535.878682:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+10:13799:x1874433522379392:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787599535.878939:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+10:13799:x1874433522379392:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 259us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599535.878947:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:3.0:1787599535.890048:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599535.891320:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522379520 00000100:00100000:2.0:1787599535.891332:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522379520 00000100:00100000:2.0:1787599535.891413:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 90 00000100:00100000:2.0:1787599535.891425:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+10:13799:x1874433522379520:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599535.891703:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+10:13799:x1874433522379520:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 279us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599535.891711:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 90 00000100:00100000:3.0:1787599535.908783:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599535.909541:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522379648 00000100:00100000:2.0:1787599535.909552:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522379648 00000100:00100000:2.0:1787599535.909609:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1787599535.909629:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1874433522379648:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787599535.909679:0:14406:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 67b8f013-3a86-409b-99d3-ab128d48ac43@192.168.204.30@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:2.0:1787599535.909733:0:14406:0:(genops.c:1385:class_connect()) connect: client 67b8f013-3a86-409b-99d3-ab128d48ac43, cookie 0xa46cbc6741183971 00000004:00100000:2.0:1787599535.909767:0:14406:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787599535.909774:0:14406:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787599536.018649:0:14406:0:(import.c:65:import_set_state_nolock()) ffff9f6c5808e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599536.018738:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2355:x1874433522379648:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 109118us (109979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599536.018749:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:3.0:1787599536.027421:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599536.028518:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599536.028622:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522379904 00000100:00100000:2.0:1787599536.028632:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522379904 00000100:00100000:2.0:1787599536.028706:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522379776 00000100:00100000:2.0:1787599536.028710:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522379776 00000100:00100000:2.0:1787599536.028735:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1787599536.028744:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+7:13774:x1874433522379904:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787599536.028789:0:14405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787599536.028872:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+7:13774:x1874433522379904:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 128us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599536.028880:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1787599536.028900:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:2.0:1787599536.028907:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:0:x1874433522379776:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787599536.028919:0:14405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787599536.028942:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:0:x1874433522379776:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 36us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599536.028948:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00080000:3.0:1787599536.029051:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599536.036504:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599536.036738:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522380032 00000100:00100000:2.0:1787599536.036763:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522380032 00000100:00100000:2.0:1787599536.036828:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1787599536.036840:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:13774:x1874433522380032:12345-192.168.204.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787599536.036931:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:13774:x1874433522380032:12345-192.168.204.30@tcp:40:mount.lustre.0 Request processed in 93us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599536.036938:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:0.0:1787599536.040680:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599536.040721:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599536.040811:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522380160 00000100:00100000:1.0:1787599536.040821:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522380160 00000100:00100000:1.0:1787599536.040867:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522380288 00000100:00100000:1.0:1787599536.040870:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522380288 00000100:00100000:1.0:1787599536.040884:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787599536.040893:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874433522380160:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787599536.040923:0:15091:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 67b8f013-3a86-409b-99d3-ab128d48ac43@192.168.204.30@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:1.0:1787599536.040958:0:15091:0:(genops.c:1385:class_connect()) connect: client 67b8f013-3a86-409b-99d3-ab128d48ac43, cookie 0xa46cbc6741183978 00002000:00100000:1.0:1787599536.040970:0:15091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 67b8f013-3a86-409b-99d3-ab128d48ac43/ffff9f6b4664c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599536.040995:0:15091:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599536.041372:0:15091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787599536.041400:0:15091:0:(import.c:65:import_set_state_nolock()) ffff9f6b4664a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599536.041465:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2355:x1874433522380160:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 571us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599536.041473:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787599536.041493:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1787599536.041498:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874433522380288:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787599536.041513:0:15091:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 67b8f013-3a86-409b-99d3-ab128d48ac43@192.168.204.30@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:1.0:1787599536.041531:0:15091:0:(genops.c:1385:class_connect()) connect: client 67b8f013-3a86-409b-99d3-ab128d48ac43, cookie 0xa46cbc674118397f 00002000:00100000:1.0:1787599536.041538:0:15091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 67b8f013-3a86-409b-99d3-ab128d48ac43/ffff9f6b4664e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599536.041551:0:15091:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599536.041666:0:15091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787599536.041694:0:15091:0:(import.c:65:import_set_state_nolock()) ffff9f6b4664d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599536.041717:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2355:x1874433522380288:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 217us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599536.041724:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1787599536.056884:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599536.058217:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522380416 00000100:00100000:1.0:1787599536.058230:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522380416 00000100:00100000:1.0:1787599536.058297:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1787599536.058308:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:13774:x1874433522380416:12345-192.168.204.30@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787599536.065013:0:14408:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6624us 00000004:00200000:1.0:1787599536.084821:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787599536.085017:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:13774:x1874433522380416:12345-192.168.204.30@tcp:33:mount.lustre.0 Request processed in 26706us (28138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599536.085028:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:0.0:1787599536.161562:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543345408:0@lo:400:kworker.0 00000100:00100000:2.0:1787599536.161840:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543345152:0@lo:400:kworker.0 00000100:00100000:1.0:1787599536.161940:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543345280:0@lo:400:kworker.0 00000100:00100000:3.0:1787599536.162020:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543345024:0@lo:400:kworker.0 00000100:00100000:2.0:1787599536.166534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599536.166801:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543345664:0@lo:400:kworker.0 00000100:00100000:2.0:1787599536.166853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599536.169125:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543345152 00000100:00100000:2.0:1787599536.169141:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543345152 00000100:00100000:2.0:1787599536.169219:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599536.169230:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543345152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599536.169318:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543345152:12345-0@lo:400:kworker.0 Request processed in 90us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599536.169325:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599536.169385:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543345152:0@lo:400:kworker.0 00000100:00080000:2.0:1787599536.169443:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599536.169485:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543345664 00000100:00100000:2.0:1787599536.169489:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543345664 00000100:00100000:2.0:1787599536.169521:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599536.169528:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543345664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599536.169565:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543345664:12345-0@lo:400:kworker.0 Request processed in 38us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599536.169571:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787599536.169597:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599536.169765:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599536.169809:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543345792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599536.169843:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599536.169866:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543345792 00000100:00100000:1.0:1787599536.169869:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543345792 00000100:00100000:1.0:1787599536.169905:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599536.169911:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1874433543345792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599536.169926:0:15093:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599536.169956:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1874433543345792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599536.169962:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787599536.169979:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599536.170016:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543345792:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787599536.173320:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75de9500 x1874433543345664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599536.173356:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543345664:0@lo:400:kworker.0 00000100:00100000:2.0:1787599536.173427:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543345280 00000100:00100000:2.0:1787599536.173435:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543345280 00000100:00100000:2.0:1787599536.173487:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599536.173496:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1874433543345280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599536.173582:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1874433543345280:12345-0@lo:400:kworker.0 Request processed in 87us (3818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599536.173589:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599536.175001:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599536.175043:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543345024 00000100:00100000:3.0:1787599536.175049:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543345024 00000100:00100000:3.0:1787599536.175085:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787599536.175093:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b449b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3302:x1874433543345024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599536.175133:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b449b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3302:x1874433543345024:12345-0@lo:400:kworker.0 Request processed in 41us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599536.175146:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787599536.175216:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543345024:0@lo:400:kworker.0 00000100:00100000:3.0:1787599536.175227:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543345536:0@lo:400:kworker.0 00000100:00100000:3.0:1787599536.175259:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599536.175283:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543345536 00000100:00100000:3.0:1787599536.175286:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543345536 00000100:00100000:3.0:1787599536.175326:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599536.175333:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543345536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599536.175376:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543345536:12345-0@lo:400:kworker.0 Request processed in 44us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599536.175382:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787599536.175399:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787599536.175419:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75dea680 x1874433543345536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599536.175429:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543345536:0@lo:400:kworker.0 00000100:00100000:3.0:1787599536.179409:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543345280:0@lo:400:kworker.0 00000100:00100000:0.0:1787599536.184686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599536.184762:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543345408 00000100:00100000:0.0:1787599536.184772:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543345408 00000100:00100000:0.0:1787599536.184828:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787599536.184839:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543345408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599536.184910:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543345408:12345-0@lo:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599536.184917:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787599536.184964:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f6c75de8a80 x1874433543345408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599536.184979:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543345408:0@lo:400:kworker.0 00000001:00100000:0.0:1787599536.308650:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 67b8f013-3a86-409b-99d3-ab128d48ac43 00000001:00080000:0.0:1787599536.308668:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787599536.308748:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787599536.447677:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599536.447773:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522380544 00000100:00100000:3.0:1787599536.447782:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522380544 00000100:00100000:3.0:1787599536.447844:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:3.0:1787599536.447854:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:13820:x1874433522380544:12345-192.168.204.30@tcp:101:mkdir.0 00010000:00010000:3.0:1787599536.447874:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599536.450375:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741183986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e075cd expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599536.451082:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc674118398d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599536.451101:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc674118398d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599536.451120:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc674118398d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599536.451436:0:14405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787599536.451441:0:14405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599536.451554:0:14405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc674118398d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599536.451588:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c600/0xa46cbc6741183986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075cd expref: 8 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599536.451606:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc674118398d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075cd expref: 7 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599536.451615:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c5b122600) 00010000:00010000:3.0:1787599536.451619:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599536.451622:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c800, rc 0) 00000100:00100000:3.0:1787599536.451703:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+7:13820:x1874433522380544:12345-192.168.204.30@tcp:101:mkdir.0 Request processed in 3849us (4036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599536.451712:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00010000:00010000:2.0:1787599536.801605:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599537.825983:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599538.725333:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599538.725428:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543345920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599538.725522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599538.727949:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543345920 00000100:00100000:2.0:1787599538.727967:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543345920 00000100:00100000:2.0:1787599538.728121:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599538.728135:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543345920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599538.728190:0:15093:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599538.729705:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543345920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1567us (4175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599538.729719:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599538.731403:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543345920:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787599538.732017:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787599538.853077:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599538.928118:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599538.928416:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522380672 00000100:00100000:2.0:1787599538.928431:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522380672 00000100:00100000:2.0:1787599538.928532:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:2.0:1787599538.928549:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+7:13873:x1874433522380672:12345-192.168.204.30@tcp:41:lfs.0 00000004:00000024:2.0:1787599538.928621:0:14407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1787599538.928825:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599538.929260:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+7:13873:x1874433522380672:12345-192.168.204.30@tcp:41:lfs.0 Request processed in 715us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599538.929287:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787599538.939807:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599538.940281:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522380800 00000100:00100000:2.0:1787599538.940305:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522380800 00000100:00100000:2.0:1787599538.940403:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1787599538.940416:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:67b8f013-3a86-409b-99d3-ab128d48ac43+6:13873:x1874433522380800:12345-192.168.204.30@tcp:13:lfs.0 00002000:00000024:2.0:1787599538.940457:0:15092:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599538.940584:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:67b8f013-3a86-409b-99d3-ab128d48ac43+6:13873:x1874433522380800:12345-192.168.204.30@tcp:13:lfs.0 Request processed in 171us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599538.940593:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00080000:3.0:1787599538.940686:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599538.944579:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599538.946338:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522380928 00000100:00100000:2.0:1787599538.946357:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522380928 00000100:00100000:2.0:1787599538.946469:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:2.0:1787599538.946485:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:67b8f013-3a86-409b-99d3-ab128d48ac43+5:13873:x1874433522380928:12345-192.168.204.30@tcp:13:lfs.0 00002000:00000024:2.0:1787599538.946538:0:15092:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599538.946683:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:67b8f013-3a86-409b-99d3-ab128d48ac43+5:13873:x1874433522380928:12345-192.168.204.30@tcp:13:lfs.0 Request processed in 202us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599538.946691:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00080000:3.0:1787599538.948262:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599539.200725:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599539.200932:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522381056 00000100:00100000:2.0:1787599539.200947:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522381056 00000100:00100000:2.0:1787599539.201029:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00100000:2.0:1787599539.201043:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+10:13903:x1874433522381056:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599539.201078:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599539.201112:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40030600/0xa46cbc6741183994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e075d4 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.201224:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40030600/0xa46cbc6741183994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075d4 expref: 11 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.201238:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40030600/0xa46cbc6741183994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075d4 expref: 11 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.201250:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030600, rc 0) 00000100:00100000:2.0:1787599539.201347:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+11:13903:x1874433522381056:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 307us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.201355:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 92 00000100:00100000:0.0:1787599539.216414:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599539.219070:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522381184 00000100:00100000:3.0:1787599539.219104:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522381184 00000100:00100000:3.0:1787599539.219254:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 93 00000100:00100000:3.0:1787599539.219278:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+11:13903:x1874433522381184:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787599539.220104:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+11:13903:x1874433522381184:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 813us (3690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599539.220116:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 93 00000100:00100000:0.0:1787599539.243911:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599539.245884:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522381312 00000100:00100000:3.0:1787599539.245913:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522381312 00000100:00100000:3.0:1787599539.246010:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 94 00000100:00100000:3.0:1787599539.246023:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+11:13903:x1874433522381312:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787599539.247245:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+11:13903:x1874433522381312:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 420us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599539.247270:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 94 00000100:00100000:2.0:1787599539.278405:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599539.278839:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522381440 00000100:00100000:0.0:1787599539.278853:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522381440 00000100:00100000:0.0:1787599539.279118:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 95 00000100:00100000:0.0:1787599539.279132:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+11:13912:x1874433522381440:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787599539.281527:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+11:13912:x1874433522381440:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 2382us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599539.281545:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 95 00000100:00100000:0.0:1787599539.334350:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599539.334754:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522381568 00000100:00100000:2.0:1787599539.334770:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522381568 00000100:00100000:2.0:1787599539.334856:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:2.0:1787599539.335129:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+11:13912:x1874433522381568:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599539.337826:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+11:13912:x1874433522381568:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 2367us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.337848:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:1.0:1787599539.359342:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599539.359918:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522381696 00000100:00100000:0.0:1787599539.359932:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522381696 00000100:00100000:0.0:1787599539.360006:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00100000:0.0:1787599539.360019:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+11:13903:x1874433522381696:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787599539.360042:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599539.360065:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118399b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e075fe expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599539.360102:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118399b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075fe expref: 12 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599539.360139:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c751ff400/0xa46cbc674118399b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075fe expref: 12 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599539.360151:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c751ff400, rc 0) 00000100:00100000:0.0:1787599539.364369:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+12:13903:x1874433522381696:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 2414us (3103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599539.364390:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00100000:0.0:1787599539.386289:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599539.387106:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522381824 00000100:00100000:2.0:1787599539.387123:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522381824 00000100:00100000:2.0:1787599539.387239:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 98 00000100:00100000:2.0:1787599539.387508:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+12:13903:x1874433522381824:12345-192.168.204.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787599539.387546:0:14399:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787599539.387707:0:14399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787599539.387712:0:14399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787599539.388001:0:14399:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787599539.388005:0:14399:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787599539.401397:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+12:13903:x1874433522381824:12345-192.168.204.30@tcp:256:mount.lustre.0 Request processed in 14129us (15114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.401418:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 98 00000100:00100000:1.0:1787599539.405117:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599539.405395:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522381952 00000100:00100000:2.0:1787599539.405411:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522381952 00000100:00100000:2.0:1787599539.405488:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:2.0:1787599539.405502:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+12:13903:x1874433522381952:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599539.405525:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599539.405560:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40031400/0xa46cbc67411839a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07605 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.405599:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40031400/0xa46cbc67411839a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07605 expref: 13 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.405612:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40031400/0xa46cbc67411839a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07605 expref: 13 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.406048:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031400, rc 0) 00000100:00100000:2.0:1787599539.406823:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+13:13903:x1874433522381952:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 1317us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.406835:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:0.0:1787599539.412341:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599539.412732:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522382080 00000100:00100000:2.0:1787599539.412747:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522382080 00000100:00100000:2.0:1787599539.412830:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 100 00000100:00100000:2.0:1787599539.412843:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+13:13903:x1874433522382080:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787599539.415310:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+13:13903:x1874433522382080:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 2443us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.415339:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 100 00000100:00100000:1.0:1787599539.428832:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599539.430411:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522382208 00000100:00100000:2.0:1787599539.430430:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522382208 00000100:00100000:2.0:1787599539.430520:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 101 00000100:00100000:2.0:1787599539.430534:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+13:13903:x1874433522382208:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787599539.433225:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+13:13903:x1874433522382208:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 2675us (4392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.433244:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 101 00000100:00100000:1.0:1787599539.452394:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599539.453772:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522382336 00000100:00100000:2.0:1787599539.453791:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522382336 00000100:00100000:2.0:1787599539.453894:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 102 00000100:00100000:2.0:1787599539.453907:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+13:13916:x1874433522382336:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599539.454392:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+13:13916:x1874433522382336:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 486us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.454402:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 102 00000100:00100000:0.0:1787599539.464342:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599539.464766:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522382464 00000100:00100000:2.0:1787599539.464780:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522382464 00000100:00100000:2.0:1787599539.464860:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 103 00000100:00100000:2.0:1787599539.464886:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+13:13916:x1874433522382464:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599539.465297:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+13:13916:x1874433522382464:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 425us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.465307:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 103 00000100:00100000:0.0:1787599539.487595:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599539.488071:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599539.497505:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522382592 00000100:00100000:3.0:1787599539.497527:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522382592 00000100:00100000:1.0:1787599539.497844:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522382976 00000100:00100000:1.0:1787599539.497851:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522382976 00000100:00100000:1.0:1787599539.497949:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1787599539.497963:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+7:2357:x1874433522382976:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599539.498088:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+7:2357:x1874433522382976:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 128us (10018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599539.498096:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1787599539.498201:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599539.498378:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599539.500649:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1787599539.500663:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1874433522382592:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787599539.500704:0:14405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a6629fd8-f639-4f53-ba01-94b418582f16@192.168.204.30@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:3.0:1787599539.501081:0:14405:0:(genops.c:1385:class_connect()) connect: client a6629fd8-f639-4f53-ba01-94b418582f16, cookie 0xa46cbc67411839a9 00000004:00100000:3.0:1787599539.501146:0:14405:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787599539.501385:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522383232 00000100:00100000:2.0:1787599539.501397:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522383232 00000100:00100000:2.0:1787599539.501454:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522383104 00000100:00100000:2.0:1787599539.501458:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522383104 00000100:00100000:2.0:1787599539.501477:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1787599539.501485:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2357:x1874433522383232:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599539.501591:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2357:x1874433522383232:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 107us (3391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.501599:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1787599539.501636:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1787599539.501643:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2357:x1874433522383104:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599539.501671:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2357:x1874433522383104:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 29us (3293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.501678:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00080000:3.0:1787599539.503536:0:14405:0:(import.c:65:import_set_state_nolock()) ffff9f6c70850800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599539.505211:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6629fd8-f639-4f53-ba01-94b418582f16+6:2355:x1874433522382592:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 4534us (17619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599539.505230:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1787599539.522393:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599539.522524:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599539.526690:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522382848 00000100:00100000:0.0:1787599539.526723:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522382848 00000100:00100000:0.0:1787599539.526837:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522382720 00000100:00100000:0.0:1787599539.526841:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522382720 00000100:00100000:0.0:1787599539.527125:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1787599539.527142:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6629fd8-f639-4f53-ba01-94b418582f16+7:13903:x1874433522382848:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787599539.527218:0:15521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787599539.527401:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6629fd8-f639-4f53-ba01-94b418582f16+7:13903:x1874433522382848:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 264us (5023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599539.527410:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1787599539.527436:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:0.0:1787599539.527445:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6629fd8-f639-4f53-ba01-94b418582f16+6:0:x1874433522382720:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787599539.527457:0:15521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787599539.527506:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6629fd8-f639-4f53-ba01-94b418582f16+6:0:x1874433522382720:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 63us (4983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599539.527513:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00080000:3.0:1787599539.528095:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599539.530742:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599539.541697:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522383360 00000100:00100000:1.0:1787599539.541729:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522383360 00000100:00100000:1.0:1787599539.541836:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1787599539.541851:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6629fd8-f639-4f53-ba01-94b418582f16+6:13903:x1874433522383360:12345-192.168.204.30@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787599539.542005:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6629fd8-f639-4f53-ba01-94b418582f16+6:13903:x1874433522383360:12345-192.168.204.30@tcp:40:mount.lustre.0 Request processed in 157us (11289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599539.542014:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:2.0:1787599539.551342:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599539.551455:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522383744 00000100:00100000:3.0:1787599539.551467:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522383744 00000100:00100000:3.0:1787599539.551539:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:3.0:1787599539.551563:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6629fd8-f639-4f53-ba01-94b418582f16+6:13903:x1874433522383744:12345-192.168.204.30@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787599539.551886:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787599539.552096:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6629fd8-f639-4f53-ba01-94b418582f16+6:13903:x1874433522383744:12345-192.168.204.30@tcp:33:mount.lustre.0 Request processed in 535us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599539.552105:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1787599539.564701:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599539.564794:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599539.565483:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522383488 00000100:00100000:0.0:1787599539.565498:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522383488 00000100:00100000:0.0:1787599539.565553:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522383616 00000100:00100000:0.0:1787599539.565557:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522383616 00000100:00100000:0.0:1787599539.565574:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1787599539.565584:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874433522383488:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787599539.565638:0:15088:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a6629fd8-f639-4f53-ba01-94b418582f16@192.168.204.30@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1787599539.565679:0:15088:0:(genops.c:1385:class_connect()) connect: client a6629fd8-f639-4f53-ba01-94b418582f16, cookie 0xa46cbc67411839b0 00002000:00100000:0.0:1787599539.565694:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a6629fd8-f639-4f53-ba01-94b418582f16/ffff9f6c6a2a1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787599539.565709:0:15088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787599539.565869:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787599539.565920:0:15088:0:(import.c:65:import_set_state_nolock()) ffff9f6c6a2a0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599539.566017:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6629fd8-f639-4f53-ba01-94b418582f16+6:2355:x1874433522383488:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 432us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599539.566026:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1787599539.566048:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:0.0:1787599539.566053:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874433522383616:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787599539.566070:0:15088:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a6629fd8-f639-4f53-ba01-94b418582f16@192.168.204.30@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1787599539.566086:0:15088:0:(genops.c:1385:class_connect()) connect: client a6629fd8-f639-4f53-ba01-94b418582f16, cookie 0xa46cbc67411839b7 00002000:00100000:0.0:1787599539.566092:0:15088:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a6629fd8-f639-4f53-ba01-94b418582f16/ffff9f6c6a2a0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787599539.566099:0:15088:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787599539.566401:0:15088:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787599539.566420:0:15088:0:(import.c:65:import_set_state_nolock()) ffff9f6c6a2a2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599539.566448:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a6629fd8-f639-4f53-ba01-94b418582f16+6:2355:x1874433522383616:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 393us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599539.566455:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000001:00100000:0.0:1787599539.846578:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a6629fd8-f639-4f53-ba01-94b418582f16 00000001:00100000:0.0:1787599539.846597:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 67b8f013-3a86-409b-99d3-ab128d48ac43 00010000:00010000:0.0:1787599539.873488:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599539.946354:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599539.946476:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522383872 00000100:00100000:2.0:1787599539.946505:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522383872 00000100:00100000:2.0:1787599539.946591:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:2.0:1787599539.946602:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6629fd8-f639-4f53-ba01-94b418582f16+6:13937:x1874433522383872:12345-192.168.204.30@tcp:101:mkdir.0 00010000:00010000:2.0:1787599539.946623:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599539.946655:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc67411839be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0762f expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.946731:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.946747:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.946787:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599539.947006:0:14405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787599539.947011:0:14405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599539.947092:0:14405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.947121:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc67411839be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0762f expref: 8 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.947139:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0762f expref: 7 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599539.947147:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c5b122600) 00010000:00010000:2.0:1787599539.947150:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599539.947213:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031e00, rc 0) 00000100:00100000:2.0:1787599539.947306:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6629fd8-f639-4f53-ba01-94b418582f16+7:13937:x1874433522383872:12345-192.168.204.30@tcp:101:mkdir.0 Request processed in 706us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599539.947314:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00010000:00010000:2.0:1787599540.897516:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599541.282199:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599541.282224:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543346048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599541.282306:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599541.282707:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543346048 00000100:00100000:1.0:1787599541.282715:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543346048 00000100:00100000:1.0:1787599541.282777:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599541.282785:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543346048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599541.282838:0:15092:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599541.282890:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543346048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599541.282896:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599541.283006:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787599541.283029:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543346048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599541.285130:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3299:1874433543346176:0@lo:400:kworker.0 00000100:00100000:0.0:1787599541.285212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599541.285244:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543346688:0@lo:400:kworker.0 00000100:00100000:0.0:1787599541.285290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599541.285313:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599541.285319:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543346304:0@lo:400:kworker.0 00000100:00100000:0.0:1787599541.285339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599541.285364:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543346432:0@lo:400:kworker.0 00000100:00100000:0.0:1787599541.285383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599541.285397:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599541.285402:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543346560:0@lo:400:kworker.0 00000100:00100000:0.0:1787599541.285418:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787599541.285536:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599541.285555:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543346688 00000100:00100000:2.0:1787599541.285562:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543346688 00000100:00100000:2.0:1787599541.285617:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543346432 00000100:00100000:2.0:1787599541.285630:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543346432 00000100:00100000:2.0:1787599541.285645:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543346560 00000100:00100000:2.0:1787599541.285647:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543346560 00000100:00100000:2.0:1787599541.285664:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599541.285673:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543346688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599541.285746:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874433543346688:12345-0@lo:400:kworker.0 Request processed in 74us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599541.285755:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599541.285775:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599541.285780:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543346432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599541.285974:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874433543346432:12345-0@lo:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599541.285982:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599541.285995:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599541.286002:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543346560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599541.287090:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874433543346432:0@lo:400:kworker.0 00000100:00080000:3.0:1787599541.290204:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599541.292739:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543346560:12345-0@lo:400:kworker.0 Request processed in 6715us (7296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599541.292755:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599541.292930:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874433543346688:0@lo:400:kworker.0 00000100:00100000:2.0:1787599541.292982:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543346176 00000100:00100000:2.0:1787599541.292988:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543346176 00000100:00100000:2.0:1787599541.293024:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787599541.293033:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3299:x1874433543346176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599541.293105:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3299:x1874433543346176:12345-0@lo:400:kworker.0 Request processed in 72us (7893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599541.293113:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787599541.293129:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543346560:0@lo:400:kworker.0 00000100:00100000:0.0:1787599541.293195:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543346304 00000100:00100000:2.0:1787599541.293201:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3299:1874433543346176:0@lo:400:kworker.0 00000100:00100000:0.0:1787599541.293201:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543346304 00000100:00100000:0.0:1787599541.293280:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599541.293291:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543346304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599541.294439:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543346304:12345-0@lo:400:kworker.0 Request processed in 1044us (8990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599541.294452:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787599541.294485:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599541.294533:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543346304:0@lo:400:kworker.0 00000001:00100000:2.0:1787599541.348496:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 67b8f013-3a86-409b-99d3-ab128d48ac43 00000001:00100000:2.0:1787599541.348529:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a6629fd8-f639-4f53-ba01-94b418582f16 00000001:00100000:1.0:1787599541.355414:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a6629fd8-f639-4f53-ba01-94b418582f16 00010000:00010000:0.0:1787599541.921450:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599542.949728:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787599543.290989:0:16367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787599543.841622:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543346816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599543.841693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599543.842248:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543346816 00000100:00100000:2.0:1787599543.842256:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543346816 00000100:00080000:3.0:1787599543.842309:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599543.842374:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599543.842386:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543346816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787599543.842420:0:15092:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787599543.842476:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543346816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599543.842484:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599543.842557:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543346816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787599543.970389:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599544.973682:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599544.973709:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599544.973734:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599544.973760:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599544.973778:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599544.973792:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599544.973814:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599544.973902:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522384128 00000100:00100000:3.0:1787599544.973913:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522384128 00000100:00100000:3.0:1787599544.973980:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522384512 00000100:00100000:3.0:1787599544.973983:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522384512 00000100:00100000:3.0:1787599544.974024:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:3.0:1787599544.974035:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2359:x1874433522384128:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599544.974112:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2359:x1874433522384128:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 79us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599544.974120:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:3.0:1787599544.974151:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:3.0:1787599544.974187:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6629fd8-f639-4f53-ba01-94b418582f16+6:2359:x1874433522384512:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599544.974215:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6629fd8-f639-4f53-ba01-94b418582f16+6:2359:x1874433522384512:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 57us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599544.974221:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00080000:3.0:1787599544.974238:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599544.974980:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522384384 00000100:00100000:2.0:1787599544.974988:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522384384 00000100:00100000:2.0:1787599544.975043:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522384640 00000100:00100000:2.0:1787599544.975046:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522384640 00000100:00100000:2.0:1787599544.975060:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522384256 00000100:00100000:2.0:1787599544.975062:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522384256 00000100:00100000:2.0:1787599544.975074:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522384768 00000100:00100000:2.0:1787599544.975077:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522384768 00000100:00100000:2.0:1787599544.975094:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1787599544.975102:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2359:x1874433522384384:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599544.975141:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2359:x1874433522384384:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 40us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599544.975149:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1787599544.975194:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:2.0:1787599544.975202:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2359:x1874433522384640:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599544.975241:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2359:x1874433522384640:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 39us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599544.975247:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:2.0:1787599544.975259:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:2.0:1787599544.975277:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2359:x1874433522384256:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599544.975300:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2359:x1874433522384256:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 35us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599544.975306:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:2.0:1787599544.975317:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:2.0:1787599544.975323:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2359:x1874433522384768:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1787599544.975345:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2359:x1874433522384768:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 22us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599544.975350:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00080000:3.0:1787599544.976690:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599544.976699:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599544.981288:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522384000 00000100:00100000:0.0:1787599544.981302:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522384000 00000100:00100000:0.0:1787599544.981357:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 105 00000100:00100000:0.0:1787599544.981367:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+13:2359:x1874433522384000:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599544.981428:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+13:2359:x1874433522384000:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 63us (7666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599544.981436:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 105 00010000:00010000:3.0:1787599544.999825:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599545.442692:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599546.019043:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599546.401398:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543347328:0@lo:400:kworker.0 00000100:00100000:0.0:1787599546.401502:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599546.401570:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599546.401577:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543347200:0@lo:400:kworker.0 00000100:00100000:0.0:1787599546.401608:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599546.401656:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543347072:0@lo:400:kworker.0 00000100:00100000:0.0:1787599546.401689:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599546.401706:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543347584:0@lo:400:kworker.0 00000100:00100000:0.0:1787599546.401726:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599546.401745:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787599546.401751:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543346944:0@lo:400:kworker.0 00000100:00100000:0.0:1787599546.401781:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599546.401801:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543347456:0@lo:400:kworker.0 00000100:00100000:0.0:1787599546.401820:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599546.401850:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543347200 00000100:00100000:0.0:1787599546.401858:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543347200 00000100:00100000:2.0:1787599546.401861:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543347072 00000100:00100000:2.0:1787599546.401869:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543347072 00000100:00100000:2.0:1787599546.401946:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599546.401960:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543347072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599546.402037:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543347072:12345-0@lo:400:kworker.0 Request processed in 79us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599546.402045:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599546.403400:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543347328 00000100:00100000:3.0:1787599546.403413:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543347328 00000100:00100000:3.0:1787599546.404595:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543347584 00000100:00100000:3.0:1787599546.404610:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543347584 00000100:00100000:3.0:1787599546.404656:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543347456 00000100:00100000:3.0:1787599546.404660:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543347456 00000100:00100000:3.0:1787599546.404692:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787599546.404705:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543347328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599546.404826:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874433543347328:12345-0@lo:400:kworker.0 Request processed in 123us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599546.404835:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787599546.404857:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787599546.404864:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543347584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599546.404899:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543347584:12345-0@lo:400:kworker.0 Request processed in 35us (3171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599546.404906:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787599546.404919:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599546.404926:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543347456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599546.404973:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874433543347456:12345-0@lo:400:kworker.0 Request processed in 48us (3152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599546.404980:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787599546.405000:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599546.405006:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599546.405009:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599546.405052:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543347712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599546.405097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599546.405185:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543347712 00000100:00100000:3.0:1787599546.405189:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543347712 00000100:00100000:3.0:1787599546.405221:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599546.405227:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874433543347712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599546.405258:0:15093:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787599546.405297:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874433543347712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599546.405303:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599546.405350:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543347712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599546.405806:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599546.405823:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543347200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599546.405866:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543347200:12345-0@lo:400:kworker.0 Request processed in 52us (4258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599546.405873:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599546.405969:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543346944 00000100:00100000:0.0:1787599546.405974:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543346944 00000100:00100000:0.0:1787599546.406001:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599546.406007:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3302:x1874433543346944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599546.406039:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3302:x1874433543346944:12345-0@lo:400:kworker.0 Request processed in 33us (4258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599546.406045:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787599546.407053:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543347200:0@lo:400:kworker.0 00000100:00100000:1.0:1787599546.407082:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543346944:0@lo:400:kworker.0 00000100:00100000:0.0:1787599546.407087:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874433543347328:0@lo:400:kworker.0 00000100:00100000:1.0:1787599546.407108:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874433543347456:0@lo:400:kworker.0 00000100:00100000:1.0:1787599546.407126:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543347072:0@lo:400:kworker.0 00000100:00100000:1.0:1787599546.407178:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543347584:0@lo:400:kworker.0 00010000:00010000:3.0:1787599547.041379:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787599547.734890:0:16514:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3933de00 20000000:00000080:2.0:1787599547.734908:0:16514:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f6b47034400 uarg=0000000000000000 20000000:01000000:2.0:1787599547.734944:0:16514:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787599547.734966:0:16514:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787599547.734971:0:16514:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787599547.739847:0:16515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787599547.740083:0:16514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787599547.747942:0:16514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787599547.748201:0:16514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748222:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c751ffe00/0xa46cbc67411836c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411836bc expref: 18 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748230:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c751fe000/0xa46cbc6741183710 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc6741183709 expref: 18 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748237:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c751fe800/0xa46cbc6741183844 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc674118383d expref: 18 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748247:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c751fea00/0xa46cbc674118396a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075a3 expref: 12 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748254:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f6c40031400/0xa46cbc67411839a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07605 expref: 12 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748263:0:16514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748312:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c40031400/0xa46cbc67411839a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07605 expref: 12 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748325:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c40031400/0xa46cbc67411839a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07605 expref: 12 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599547.748340:0:16514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1874433543347840:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599547.748453:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c751fea00/0xa46cbc674118396a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075a3 expref: 12 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748480:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c751fea00/0xa46cbc674118396a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075a3 expref: 12 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599547.748489:0:16514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1874433543347968:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599547.748522:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c751fe800/0xa46cbc6741183844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc674118383d expref: 18 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748529:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c751fe800/0xa46cbc6741183844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc674118383d expref: 18 pid: 14399 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599547.748538:0:16514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1874433543348096:0@lo:104: 00000100:00100000:0.0:1787599547.748579:0:16514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599547.748617:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c751fe000/0xa46cbc6741183710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc6741183709 expref: 18 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748625:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c751fe000/0xa46cbc6741183710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc6741183709 expref: 18 pid: 14398 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599547.748633:0:16514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe23100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1874433543348224:0@lo:104: 00000100:00100000:0.0:1787599547.748654:0:16514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599547.748687:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f6c751ffe00/0xa46cbc67411836c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa46cbc67411836bc expref: 18 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.748702:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f6c751ffe00/0xa46cbc67411836c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa46cbc67411836bc expref: 18 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599547.748711:0:16514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe21c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1874433543348352:0@lo:104: 00000100:00100000:0.0:1787599547.748735:0:16514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599547.748758:0:16514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48af7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599547.750556:0:14389:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787599547.750581:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543348096 00000100:00100000:3.0:1787599547.750590:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543348096 00000100:00100000:3.0:1787599547.750846:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543348224 00000100:00100000:3.0:1787599547.750851:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543348224 00000100:00100000:3.0:1787599547.750863:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543348352 00000100:00100000:3.0:1787599547.750866:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543348352 00000100:00100000:3.0:1787599547.750880:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599547.750889:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+5:16514:x1874433543348096:12345-0@lo:104: 00010000:00010000:3.0:1787599547.750929:0:14389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.751016:0:14389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787599547.751023:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+5:16514:x1874433543348096:12345-0@lo:104: Request processed in 135us (2444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599547.751030:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599547.751048:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599547.751055:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+4:16514:x1874433543348224:12345-0@lo:104: 00010000:00010000:3.0:1787599547.751063:0:14389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.751097:0:14389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787599547.751102:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+4:16514:x1874433543348224:12345-0@lo:104: Request processed in 48us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599547.751107:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599547.751120:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599547.751135:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+3:16514:x1874433543348352:12345-0@lo:104: 00010000:00010000:3.0:1787599547.751143:0:14389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.751204:0:14389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787599547.751210:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+3:16514:x1874433543348352:12345-0@lo:104: Request processed in 77us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599547.751216:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787599547.751264:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787599547.751270:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.751283:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031200 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599547.751288:0:14394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.751296:0:14394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599547.751303:0:14394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599547.751309:0:14394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787599547.751343:0:14394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.751349:0:14394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599547.751368:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.751375:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c40031200/0xa46cbc674118383d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183844 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.751386:0:14394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599547.751603:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599547.751750:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599547.751756:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599547.751763:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c76067600 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:1.0:1787599547.751771:0:14393:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599547.751779:0:14393:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599547.751786:0:14393:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599547.751792:0:14393:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787599547.751806:0:14393:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599547.751812:0:14393:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599547.751827:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599547.751834:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c76067600/0xa46cbc67411836bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc67411836c3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599547.751844:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599547.751846:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599547.751847:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599547.751853:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599547.751866:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543348608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599547.752050:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.752058:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75ddf800 already unused, calling callback (ffffffffc1af6c20) 10000000:00010000:3.0:1787599547.752061:0:14394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.752080:0:14394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599547.752086:0:14394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599547.752091:0:14394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787599547.752107:0:14394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.752112:0:14394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599547.752118:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.752134:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9f6c75ddf800/0xa46cbc6741183709 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa46cbc6741183710 expref: -99 pid: 15087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.752148:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599547.752149:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599547.752151:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599547.752252:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599547.752294:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543348736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599547.752317:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599547.752338:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599547.752340:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599547.752532:0:16514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1874433543348096:0@lo:104: 00000100:00100000:0.0:1787599547.752544:0:16514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe23100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1874433543348224:0@lo:104: 00000100:00100000:0.0:1787599547.752551:0:16514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe21c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1874433543348352:0@lo:104: 00000100:00100000:3.0:1787599547.752589:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3300:1874433543348480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599547.752620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599547.754066:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543348608 00000100:00100000:0.0:1787599547.754076:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543348608 00010000:00010000:0.0:1787599547.754115:0:14392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c751ffe00/0xa46cbc67411836c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411836bc expref: 19 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599547.754147:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543348736 00000100:00100000:0.0:1787599547.754150:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543348736 00010000:00010000:0.0:1787599547.754190:0:14392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c751fe000/0xa46cbc6741183710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741183709 expref: 20 pid: 14398 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599547.754202:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543348480 00000100:00100000:0.0:1787599547.754204:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543348480 00010000:00010000:0.0:1787599547.754216:0:14392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c751fe800/0xa46cbc6741183844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118383d expref: 21 pid: 14399 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599547.754229:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599547.754237:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+21:3302:x1874433543348608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599547.754251:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599547.754257:0:14392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c751ffe00/0xa46cbc67411836c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc67411836bc expref: 21 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.754268:0:14392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c751ffe00/0xa46cbc67411836c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc67411836bc expref: 21 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.754285:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751ffe00/0xa46cbc67411836c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc67411836bc expref: 21 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.754317:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599547.754379:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+20:3302:x1874433543348608:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599547.754387:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599547.754416:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599547.754424:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3302:x1874433543348736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599547.754449:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599547.754455:0:14392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c751fe000/0xa46cbc6741183710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc6741183709 expref: 19 pid: 14398 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.754463:0:14392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c751fe000/0xa46cbc6741183710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc6741183709 expref: 19 pid: 14398 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.754473:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751fe000/0xa46cbc6741183710 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc6741183709 expref: 19 pid: 14398 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.754482:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599547.754504:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:3302:x1874433543348736:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599547.754509:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599547.754521:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599547.754527:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fcbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:3300:x1874433543348480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599547.754534:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599547.754539:0:14392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c751fe800/0xa46cbc6741183844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa46cbc674118383d expref: 17 pid: 14399 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.754546:0:14392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c751fe800/0xa46cbc6741183844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa46cbc674118383d expref: 17 pid: 14399 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.754562:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751fe800/0xa46cbc6741183844 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa46cbc674118383d expref: 17 pid: 14399 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.754570:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599547.754598:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fcbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:3300:x1874433543348480:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599547.754604:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599547.754971:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543348736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599547.754981:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3302:1874433543348608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599547.755917:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3300:1874433543348480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599547.756535:0:16514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1874433543347840:192.168.204.30@tcp:104: 00000100:00100000:1.0:1787599547.756545:0:16514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1874433543347968:192.168.204.30@tcp:104: 00010000:00010000:1.0:1787599547.756575:0:16514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599547.771867:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599547.772850:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522384896 00000100:00100000:0.0:1787599547.772867:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522384896 00010000:00010000:0.0:1787599547.772944:0:14392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c40031400/0xa46cbc67411839a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07605 expref: 13 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599547.773004:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:0.0:1787599547.773016:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4860911-c292-444e-84ed-512edcaae1da+13:2359:x1874433522384896:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599547.773037:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599547.773043:0:14392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c40031400/0xa46cbc67411839a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07605 expref: 13 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.773058:0:14392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c40031400/0xa46cbc67411839a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07605 expref: 13 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.773081:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c40031400/0xa46cbc67411839a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07605 expref: 13 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599547.773629:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599547.773709:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4860911-c292-444e-84ed-512edcaae1da+12:2359:x1874433522384896:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 693us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599547.773718:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:0.0:1787599547.781001:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599547.781115:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522385024 00000100:00100000:3.0:1787599547.781137:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522385024 00010000:00010000:3.0:1787599547.781232:0:14391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f6c751fea00/0xa46cbc674118396a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075a3 expref: 12 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599547.781275:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:3.0:1787599547.781302:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4860911-c292-444e-84ed-512edcaae1da+12:2359:x1874433522385024:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599547.781321:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599547.781342:0:14391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f6c751fea00/0xa46cbc674118396a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075a3 expref: 12 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781358:0:14391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f6c751fea00/0xa46cbc674118396a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075a3 expref: 12 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781380:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c751fea00/0xa46cbc674118396a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075a3 expref: 12 pid: 14400 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781410:0:14391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781420:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781441:0:14391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781449:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781457:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781464:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781471:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e18c00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599547.781476:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781491:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781513:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599547.781527:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599547.781606:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4860911-c292-444e-84ed-512edcaae1da+11:2359:x1874433522385024:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 307us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599547.781617:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00010000:00010000:1.0:1787599547.781655:0:16514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599547.781673:0:16514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599547.781681:0:16514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f6c75e18c00/0xa46cbc67411839cc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599548.066259:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599548.963970:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599548.964001:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543348864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599548.964090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599548.966844:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543348864 00000100:00100000:1.0:1787599548.966877:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543348864 00000100:00100000:1.0:1787599548.967015:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787599548.967030:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543348864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599548.967088:0:15093:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599548.967270:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874433543348864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (3179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599548.967278:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599548.967425:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543348864:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787599548.967854:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1787599549.089231:0:14402:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599549.089239:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c75999000 from 10 10000000:01000000:3.0:1787599549.089244:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599549.089292:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc67411839d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599549.089305:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc67411839d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599549.089317:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc67411839d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599549.089340:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543348992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599549.089407:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599549.089454:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51840 going to sleep for 11 seconds 00000100:00100000:0.0:1787599549.089536:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543348992 00000100:00100000:0.0:1787599549.089545:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543348992 00000100:00100000:0.0:1787599549.089607:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787599549.089618:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+16:14402:x1874433543348992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599549.089632:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599549.089648:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75e18a00/0xa46cbc67411839da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411839d3 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.089672:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75e18a00/0xa46cbc67411839da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411839d3 expref: 17 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.089683:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75e18a00/0xa46cbc67411839da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411839d3 expref: 17 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.089692:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75e18a00, rc 0) 00000100:00100000:0.0:1787599549.089737:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:14402:x1874433543348992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599549.089756:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787599549.089801:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543348992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599549.089815:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc67411839d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411839da expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.089824:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc67411839d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411839da expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599549.089882:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.089922:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599549.089938:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48af7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599549.089966:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543349120 00000100:00100000:0.0:1787599549.089970:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543349120 00000100:00100000:0.0:1787599549.090003:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787599549.090010:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:14402:x1874433543349120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.090334:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:14402:x1874433543349120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599549.090342:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787599549.090374:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.090403:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.090444:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599549.090463:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48af7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787599549.090474:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543349248 00000100:00100000:0.0:1787599549.090478:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543349248 00000100:00100000:0.0:1787599549.090500:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787599549.090508:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:14402:x1874433543349248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.090646:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:14402:x1874433543349248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599549.090653:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787599549.090686:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787599549.091361:0:16556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787599549.091429:0:14402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787599549.091450:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599549.091458:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc67411839d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411839da expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.091477:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c5b24c600/0xa46cbc67411839d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411839da expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599549.091486:0:14402:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599549.091488:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6c58ba7000 from 10 10000000:01000000:0.0:1787599549.091491:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599549.091517:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75e18000/0xa46cbc67411839e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.091524:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75e18000/0xa46cbc67411839e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.091532:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75e18000/0xa46cbc67411839e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599549.091546:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.091582:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599549.091604:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48af7540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599549.091618:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543349376 00000100:00100000:0.0:1787599549.091622:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543349376 00000100:00100000:0.0:1787599549.091649:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787599549.091656:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+17:14402:x1874433543349376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599549.091665:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599549.091675:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75e18600/0xa46cbc67411839e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411839e1 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.091690:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75e18600/0xa46cbc67411839e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411839e1 expref: 18 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.091712:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75e18600/0xa46cbc67411839e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411839e1 expref: 18 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.091720:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75e18600, rc 0) 00000100:00100000:0.0:1787599549.091752:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:14402:x1874433543349376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599549.091758:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787599549.091792:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599549.091804:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75e18000/0xa46cbc67411839e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411839e8 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.091811:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75e18000/0xa46cbc67411839e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411839e8 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599549.091849:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.091875:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599549.091887:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c469a29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599549.091899:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543349504 00000100:00100000:0.0:1787599549.091902:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543349504 00000100:00100000:0.0:1787599549.091922:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787599549.091928:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:14402:x1874433543349504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.092109:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:14402:x1874433543349504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599549.092116:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787599549.092143:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.092196:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.092229:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599549.092247:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c469a29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599549.092257:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543349632 00000100:00100000:0.0:1787599549.092260:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543349632 00000100:00100000:0.0:1787599549.092280:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787599549.092286:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:14402:x1874433543349632:12345-0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1787599549.092687:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599549.098093:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:14402:x1874433543349632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5797us (5853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599549.098119:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787599549.099068:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787599549.109539:0:16558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787599549.111194:0:14402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787599549.111238:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599549.111251:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75e18000/0xa46cbc67411839e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411839e8 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.111264:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75e18000/0xa46cbc67411839e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411839e8 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599549.111275:0:14402:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599549.111279:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f6b45127800 from 10 10000000:01000000:0.0:1787599549.111282:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599549.111318:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75e19600/0xa46cbc67411839ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.111326:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff9f6c75e19600/0xa46cbc67411839ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.111337:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff9f6c75e19600/0xa46cbc67411839ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599549.111373:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.111442:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599549.111488:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c469a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599549.112190:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543349760 00000100:00100000:2.0:1787599549.112200:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543349760 00000100:00100000:2.0:1787599549.112255:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787599549.112267:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+18:14402:x1874433543349760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599549.112282:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599549.112295:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c40031200/0xa46cbc67411839f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa46cbc67411839ef expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599549.112320:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c40031200/0xa46cbc67411839f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa46cbc67411839ef expref: 19 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599549.112329:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c40031200/0xa46cbc67411839f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa46cbc67411839ef expref: 19 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599549.112338:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031200, rc 0) 00000100:00100000:2.0:1787599549.112385:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:14402:x1874433543349760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599549.112392:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787599549.114206:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599549.114232:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff9f6c75e19600/0xa46cbc67411839ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411839f6 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.114245:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff9f6c75e19600/0xa46cbc67411839ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa46cbc67411839f6 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599549.114330:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599549.114386:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599549.114430:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c469a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599549.115080:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543349888 00000100:00100000:2.0:1787599549.115113:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543349888 00000100:00100000:2.0:1787599549.115182:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787599549.115193:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:14402:x1874433543349888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599549.115546:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:14402:x1874433543349888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599549.115555:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787599549.118144:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fe22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543349888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599549.127975:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543350016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599549.128063:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599549.128125:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c46a51840 going to sleep for 11 seconds 00000100:00100000:2.0:1787599549.132217:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543350016 00000100:00100000:2.0:1787599549.132238:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543350016 00000100:00100000:2.0:1787599549.132420:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787599549.132438:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:14402:x1874433543350016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599549.132780:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:14402:x1874433543350016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 348us (4717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599549.132792:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787599549.135119:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2ecb12f6-efb3-4b22-8787-68be26cc19d4:14402:1874433543350016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787599549.136629:0:16562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787599549.136936:0:14402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787599549.139294:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787599549.139321:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9f6c75e19600/0xa46cbc67411839ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411839f6 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599549.139334:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff9f6c75e19600/0xa46cbc67411839ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa46cbc67411839f6 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599549.441696:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599549.441821:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522385152 00000100:00100000:0.0:1787599549.441832:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522385152 00000100:00100000:0.0:1787599549.441893:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00100000:0.0:1787599549.441906:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+11:13788:x1874433522385152:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599549.441924:0:14400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599549.441943:0:14400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75e19c00/0xa46cbc67411839fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07636 expref: -99 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.441974:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75e19c00/0xa46cbc67411839fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07636 expref: 12 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.441986:0:14400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75e19c00/0xa46cbc67411839fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07636 expref: 12 pid: 14400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.442008:0:14400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75e19c00, rc 0) 00000100:00100000:0.0:1787599549.442075:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+12:13788:x1874433522385152:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 172us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599549.442083:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 116 00000100:00100000:3.0:1787599549.445902:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599549.446017:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522385280 00000100:00100000:1.0:1787599549.446027:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522385280 00000100:00100000:1.0:1787599549.446082:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:1.0:1787599549.446102:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+12:13788:x1874433522385280:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599549.446397:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+12:13788:x1874433522385280:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 306us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599549.446410:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:1.0:1787599549.449225:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599549.449905:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522385408 00000100:00100000:2.0:1787599549.449917:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522385408 00000100:00100000:2.0:1787599549.449975:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:2.0:1787599549.449987:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+12:13788:x1874433522385408:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787599549.450366:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+12:13788:x1874433522385408:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 379us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599549.450376:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:3.0:1787599549.457211:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599549.457467:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522385536 00000100:00100000:0.0:1787599549.457477:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522385536 00000100:00100000:0.0:1787599549.457528:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:0.0:1787599549.457539:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+12:13788:x1874433522385536:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599549.457556:0:14398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599549.457574:0:14398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f6c75e18800/0xa46cbc6741183a04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0763d expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.457603:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f6c75e18800/0xa46cbc6741183a04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0763d expref: 13 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.457616:0:14398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f6c75e18800/0xa46cbc6741183a04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0763d expref: 13 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599549.457625:0:14398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75e18800, rc 0) 00000100:00100000:0.0:1787599549.458109:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+13:13788:x1874433522385536:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 571us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599549.458118:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:0.0:1787599549.460107:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599549.460901:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522385664 00000100:00100000:2.0:1787599549.460913:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522385664 00000100:00100000:2.0:1787599549.460976:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:2.0:1787599549.460988:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+13:13788:x1874433522385664:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599549.461646:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4860911-c292-444e-84ed-512edcaae1da+13:13788:x1874433522385664:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 657us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599549.461666:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:2.0:1787599549.467512:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599549.467664:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522385792 00000100:00100000:1.0:1787599549.467735:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522385792 00000100:00100000:1.0:1787599549.467794:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:1.0:1787599549.467805:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+13:13788:x1874433522385792:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599549.468044:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4860911-c292-444e-84ed-512edcaae1da+13:13788:x1874433522385792:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 239us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599549.468053:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 121 00000100:00100000:3.0:1787599550.084594:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599550.084628:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599550.084674:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599550.084692:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599550.084707:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599550.084731:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599550.084767:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522386048 00000100:00100000:3.0:1787599550.084776:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522386048 00000100:00100000:3.0:1787599550.084823:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522386560 00000100:00100000:3.0:1787599550.084826:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522386560 00000100:00100000:3.0:1787599550.084839:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522386176 00000100:00100000:3.0:1787599550.084841:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522386176 00000100:00100000:3.0:1787599550.084865:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522386432 00000100:00100000:3.0:1787599550.084868:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522386432 00000100:00100000:3.0:1787599550.084884:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1787599550.084894:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2357:x1874433522386048:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599550.084962:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2357:x1874433522386048:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 69us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599550.084969:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1787599550.084984:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1787599550.085003:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2357:x1874433522386560:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599550.085031:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2357:x1874433522386560:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599550.085036:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1787599550.085047:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:3.0:1787599550.085054:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2357:x1874433522386176:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599550.085086:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2357:x1874433522386176:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599550.085093:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:3.0:1787599550.085104:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1787599550.085110:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2357:x1874433522386432:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599550.085133:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2357:x1874433522386432:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599550.085139:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00080000:3.0:1787599550.085181:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599550.085185:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599550.085463:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522386304 00000100:00100000:1.0:1787599550.085468:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522386304 00000100:00100000:1.0:1787599550.085508:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522385920 00000100:00100000:1.0:1787599550.085512:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522385920 00000100:00100000:1.0:1787599550.085531:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:1.0:1787599550.085538:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6629fd8-f639-4f53-ba01-94b418582f16+6:2357:x1874433522386304:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599550.085579:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6629fd8-f639-4f53-ba01-94b418582f16+6:2357:x1874433522386304:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 41us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599550.085586:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:1.0:1787599550.085600:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:1.0:1787599550.085606:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2357:x1874433522385920:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1787599550.085625:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2357:x1874433522385920:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 20us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599550.085631:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00080000:3.0:1787599550.091673:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787599550.120486:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599551.137329:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599551.523263:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543350400:0@lo:400:kworker.0 00000100:00100000:1.0:1787599551.523351:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599551.523423:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787599551.523430:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543350272:0@lo:400:kworker.0 00000100:00100000:1.0:1787599551.523455:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599551.523475:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543350784:0@lo:400:kworker.0 00000100:00100000:1.0:1787599551.523499:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599551.523524:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543350400 00000100:00100000:1.0:1787599551.523530:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543350400 00000100:00100000:1.0:1787599551.523595:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543350272 00000100:00100000:1.0:1787599551.523599:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543350272 00000100:00100000:1.0:1787599551.523619:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599551.523627:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543350400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599551.523683:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543350400:12345-0@lo:400:kworker.0 Request processed in 55us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599551.523690:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599551.523718:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599551.523724:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543350272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599551.523751:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874433543350272:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599551.523757:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599551.523773:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543350784 00000100:00100000:1.0:1787599551.523776:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543350784 00000100:00100000:1.0:1787599551.523815:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599551.523822:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543350784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599551.523851:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874433543350784:12345-0@lo:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599551.523857:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599551.523907:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543350272:0@lo:400:kworker.0 00000100:00100000:1.0:1787599551.523917:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874433543350784:0@lo:400:kworker.0 00000100:00100000:1.0:1787599551.523926:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874433543350400:0@lo:400:kworker.0 00000100:00100000:3.0:1787599551.524119:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543350528:0@lo:400:kworker.0 00000100:00100000:3.0:1787599551.524153:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599551.524193:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787599551.524200:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3299:1874433543350144:0@lo:400:kworker.0 00000100:00100000:3.0:1787599551.524228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599551.524262:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543350656:0@lo:400:kworker.0 00000100:00100000:3.0:1787599551.524284:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787599551.524325:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787599551.524329:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599551.524331:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599551.524369:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543350528 00000100:00100000:3.0:1787599551.524373:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543350528 00000100:00100000:3.0:1787599551.524398:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543350656 00000100:00100000:3.0:1787599551.524401:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543350656 00000100:00100000:3.0:1787599551.524424:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599551.524431:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543350528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599551.524467:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543350528:12345-0@lo:400:kworker.0 Request processed in 37us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599551.524473:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599551.524487:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787599551.524494:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543350656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599551.524522:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874433543350656:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599551.524529:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787599551.524546:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599551.524554:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7605ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543350912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599551.524581:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787599551.524601:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599551.524632:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874433543350656:0@lo:400:kworker.0 00000100:00100000:3.0:1787599551.524642:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543350528:0@lo:400:kworker.0 00000100:00100000:2.0:1787599551.526026:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543350144 00000100:00100000:2.0:1787599551.526039:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543350144 00000100:00100000:2.0:1787599551.526096:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787599551.526104:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3299:x1874433543350144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599551.526189:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3299:x1874433543350144:12345-0@lo:400:kworker.0 Request processed in 86us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599551.526195:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787599551.526309:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543350912 00000100:00100000:1.0:1787599551.526314:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543350912 00000100:00100000:1.0:1787599551.526656:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787599551.526665:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543350912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599551.526694:0:15093:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787599551.526744:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543350912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599551.526750:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599551.527594:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7605ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543350912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599551.529109:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3299:1874433543350144:0@lo:400:kworker.0 00000100:00100000:3.0:1787599552.014356:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599552.016198:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522386688 00000100:00100000:0.0:1787599552.016231:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522386688 00000100:00100000:0.0:1787599552.016337:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1787599552.016351:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:14447:x1874433522386688:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599552.016373:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599552.016395:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19e00/0xa46cbc6741183a0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07644 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.016470:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.016485:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.016501:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.016516:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183a19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.016523:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.016531:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787599552.017183:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787599552.018262:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19400/0xa46cbc6741183a20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018278:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19400/0xa46cbc6741183a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018289:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19400/0xa46cbc6741183a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599552.018611:0:14405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787599552.018616:0:14405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599552.018721:0:14405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19400/0xa46cbc6741183a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018735:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018741:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018749:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018754:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e19200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599552.018759:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018767:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018781:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c5b122600) 00010000:00010000:0.0:1787599552.018784:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599552.018789:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018795:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018807:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018838:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183a19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018844:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183a19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018849:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e18e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599552.018852:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183a19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018859:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183a19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018867:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f6c43a07b00) 00010000:00010000:0.0:1787599552.018881:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599552.018885:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183a19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018891:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183a19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018932:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19e00/0xa46cbc6741183a0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07644 expref: 8 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018947:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19400/0xa46cbc6741183a20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07644 expref: 7 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.018954:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f6c43a07200) 00010000:00010000:0.0:1787599552.018956:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599552.018964:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75e19400, rc 0) 00000100:00100000:0.0:1787599552.019114:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+7:14447:x1874433522386688:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 2766us (4767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599552.019124:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:0.0:1787599552.027049:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599552.027135:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522386944 00000100:00100000:3.0:1787599552.027185:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522386944 00000100:00100000:3.0:1787599552.027249:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1787599552.027260:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+7:14447:x1874433522386944:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599552.027281:0:15521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599552.027300:0:15521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183a27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0764b expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.027388:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183a2e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.027403:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183a2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.027424:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183a2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.027486:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183a35 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.027495:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183a35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.027502:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183a35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.028274:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741183a3c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.028289:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741183a3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.028296:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741183a3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599552.028571:0:15521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787599552.028851:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183a2e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.028859:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183a2e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.028867:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183a2e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029088:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599552.029092:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183a2e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029101:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183a2e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029115:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f6c43a07200) 00010000:00010000:3.0:1787599552.029118:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599552.029133:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183a2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029141:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183a2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029242:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183a35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029251:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183a35 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029268:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183a35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029273:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599552.029276:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183a35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029282:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183a35 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029291:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f6c5b122100) 00010000:00010000:3.0:1787599552.029293:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599552.029296:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183a35 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029302:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183a35 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029710:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183a27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0764b expref: 10 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029727:0:15521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d600/0xa46cbc6741183a3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0764b expref: 9 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.029734:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c5b122e00) 00010000:00010000:3.0:1787599552.029736:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599552.029739:0:15521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d600, rc 0) 00000100:00100000:3.0:1787599552.029821:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+9:14447:x1874433522386944:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 2562us (2789us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787599552.029839:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:3.0:1787599552.036320:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599552.037071:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522387072 00000100:00100000:2.0:1787599552.037082:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522387072 00000100:00100000:2.0:1787599552.037151:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:2.0:1787599552.037189:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+9:14447:x1874433522387072:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787599552.037301:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+9:14447:x1874433522387072:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 115us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599552.037319:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:0.0:1787599552.155583:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599552.155758:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522387200 00000100:00100000:1.0:1787599552.155773:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522387200 00000100:00100000:1.0:1787599552.156236:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:1.0:1787599552.156249:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+9:14453:x1874433522387200:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599552.156276:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599552.156304:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7600/0xa46cbc6741183a4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07652 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.156465:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.156483:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.156497:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.156514:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.156521:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.156527:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.157624:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158520:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158531:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158559:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599552.158565:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158575:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158598:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c5b122600) 00010000:00010000:1.0:1787599552.158601:0:14406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599552.158608:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158616:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158658:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158665:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158672:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158678:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599552.158680:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158687:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158727:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f6c50836600) 00010000:00010000:1.0:1787599552.158730:0:14406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599552.158733:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158740:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158806:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7600/0xa46cbc6741183a4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07652 expref: 10 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158819:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c5b122600) 00010000:00010000:1.0:1787599552.158832:0:14406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599552.158837:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7600/0xa46cbc6741183a4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07652 expref: 10 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.158848:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6b442c7600, rc 0) 00000100:00100000:1.0:1787599552.158964:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+9:14453:x1874433522387200:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2716us (3395us total) trans 0 rc 301/301 00000100:00100000:1.0:1787599552.158976:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00010000:00010000:3.0:1787599552.162122:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599552.173199:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599552.173980:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522387328 00000100:00100000:0.0:1787599552.173996:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522387328 00000100:00100000:0.0:1787599552.174090:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:0.0:1787599552.174103:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:67b8f013-3a86-409b-99d3-ab128d48ac43+9:14453:x1874433522387328:12345-192.168.204.30@tcp:700:lfs.0 00000100:00100000:0.0:1787599552.174271:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:67b8f013-3a86-409b-99d3-ab128d48ac43+9:14453:x1874433522387328:12345-192.168.204.30@tcp:700:lfs.0 Request processed in 169us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599552.174279:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:3.0:1787599552.184840:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599552.185969:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522387584 00000100:00100000:2.0:1787599552.185987:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522387584 00000100:00100000:2.0:1787599552.186093:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:2.0:1787599552.186106:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+9:14453:x1874433522387584:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:2.0:1787599552.186221:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599552.186260:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c800/0xa46cbc674118398d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e075cd expref: 9 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.186306:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c5b122600) 00010000:00010000:2.0:1787599552.186312:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599552.186645:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.186662:0:14407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0762f expref: 5 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.186671:0:14407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.186733:0:14407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0762f expref: 5 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.186751:0:14407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0762f expref: 5 pid: 14405 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599552.186770:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75981c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14407:1874433543351040:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599552.187743:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c7660a300 going to sleep for 11 seconds 00000100:00100000:3.0:1787599552.197283:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599552.197388:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522387712 00000100:00100000:0.0:1787599552.197402:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522387712 00000100:00100000:2.0:1787599552.197485:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75981c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14407:1874433543351040:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599552.197487:0:14392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0762f expref: 6 pid: 14405 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.197527:0:14407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599552.197554:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:0.0:1787599552.197578:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6629fd8-f639-4f53-ba01-94b418582f16+6:2358:x1874433522387712:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599552.197600:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599552.197611:0:14392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0762f expref: 6 pid: 14405 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.197627:0:14392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0762f expref: 6 pid: 14405 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787599552.197648:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787599552.197684:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc67411839c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0762f expref: 6 pid: 14405 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.197703:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c5b122600) 00010000:00010000:0.0:1787599552.197709:0:14392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.197721:0:14392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.197730:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.197947:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599552.198020:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6629fd8-f639-4f53-ba01-94b418582f16+5:2358:x1874433522387712:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 454us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599552.198029:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00010000:00010000:2.0:1787599552.201956:0:14407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.201981:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.202052:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.202068:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.202083:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599552.207110:0:14407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787599552.207135:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.207148:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.208411:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.208428:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599552.208434:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.208446:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.208471:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c5b122600) 00010000:00010000:2.0:1787599552.208474:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599552.208480:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.208509:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183a5f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599552.208552:0:14407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f4313cf reply state 0000000015016641 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599552.208728:0:14407:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599552.209551:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+10:14453:x1874433522387584:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 23438us (24729us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787599552.209563:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00010000:00010000:2.0:1787599552.215458:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.215482:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.215492:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.215498:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599552.215504:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.215513:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.215535:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f6c70382100) 00010000:00010000:2.0:1787599552.215539:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599552.215544:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.215831:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a66 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599552.352600:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599552.357642:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522387840 00000100:00100000:1.0:1787599552.357674:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522387840 00000100:00100000:1.0:1787599552.357786:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:1.0:1787599552.357800:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+9:14461:x1874433522387840:12345-192.168.204.30@tcp:101:lctl.0 00010000:00010000:1.0:1787599552.357844:0:15521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599552.357879:0:15521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7600/0xa46cbc6741183a6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07659 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.357993:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.358009:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.358021:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599552.358288:0:15521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787599552.358293:0:15521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599552.358360:0:15521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.358392:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7600/0xa46cbc6741183a6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07659 expref: 11 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.358414:0:15521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7800/0xa46cbc6741183a74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07659 expref: 10 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.358424:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:1.0:1787599552.358427:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599552.358432:0:15521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6b442c7800, rc 0) 00000100:00100000:1.0:1787599552.358895:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+10:14461:x1874433522387840:12345-192.168.204.30@tcp:101:lctl.0 Request processed in 1096us (6310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599552.358905:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:3.0:1787599552.406514:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599552.407706:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522387968 00000100:00100000:0.0:1787599552.407722:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522387968 00000100:00100000:0.0:1787599552.407827:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1787599552.407840:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6629fd8-f639-4f53-ba01-94b418582f16+5:14462:x1874433522387968:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599552.407871:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599552.407897:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07660 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.407976:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18200/0xa46cbc6741183a82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.408014:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18200/0xa46cbc6741183a82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.408028:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18200/0xa46cbc6741183a82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599552.408118:0:14405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787599552.408122:0:14405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599552.408152:0:14405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18200/0xa46cbc6741183a82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.408226:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183a7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07660 expref: 7 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.408248:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18200/0xa46cbc6741183a82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07660 expref: 6 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.408258:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:0.0:1787599552.408261:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599552.408265:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75e18200, rc 0) 00000100:00100000:0.0:1787599552.408357:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6629fd8-f639-4f53-ba01-94b418582f16+6:14462:x1874433522387968:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 520us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599552.408365:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:0.0:1787599552.411414:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599552.411500:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522388096 00000100:00100000:1.0:1787599552.411512:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522388096 00000100:00100000:1.0:1787599552.411642:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:1.0:1787599552.411655:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6629fd8-f639-4f53-ba01-94b418582f16+6:14462:x1874433522388096:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1787599552.411683:0:15521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599552.411709:0:15521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7600/0xa46cbc6741183a89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07667 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.411792:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.411809:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.411822:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.411840:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7400/0xa46cbc6741183a97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.411848:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7400/0xa46cbc6741183a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.411854:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7400/0xa46cbc6741183a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414025:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414059:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414071:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599552.414143:0:15521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787599552.414147:0:15521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599552.414242:0:15521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414257:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414263:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414270:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414275:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599552.414279:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414287:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414316:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:2.0:1787599552.414319:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599552.414324:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414331:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7c00/0xa46cbc6741183a90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414349:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7400/0xa46cbc6741183a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414356:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7400/0xa46cbc6741183a97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414362:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7400/0xa46cbc6741183a97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414367:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599552.414370:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7400/0xa46cbc6741183a97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414377:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7400/0xa46cbc6741183a97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414452:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f6c50836800) 00010000:00010000:2.0:1787599552.414456:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599552.414460:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7400/0xa46cbc6741183a97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414466:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7400/0xa46cbc6741183a97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414525:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7600/0xa46cbc6741183a89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07667 expref: 8 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414539:0:15521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07667 expref: 7 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.414546:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:2.0:1787599552.414548:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599552.414551:0:15521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031600, rc 0) 00000100:00100000:2.0:1787599552.414633:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6629fd8-f639-4f53-ba01-94b418582f16+7:14462:x1874433522388096:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2980us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599552.414643:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:3.0:1787599552.424116:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599552.424662:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522388352 00000100:00100000:0.0:1787599552.424677:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522388352 00000100:00100000:0.0:1787599552.424759:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:0.0:1787599552.424774:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6629fd8-f639-4f53-ba01-94b418582f16+7:14462:x1874433522388352:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:0.0:1787599552.424827:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599552.424853:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183aa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0766e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599552.425006:0:14405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787599552.426802:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183aa5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0766e expref: 9 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.426828:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:0.0:1787599552.426832:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599552.426837:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183aa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0766e expref: 9 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.426855:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75e19200, rc 0) 00000100:00100000:0.0:1787599552.426951:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a6629fd8-f639-4f53-ba01-94b418582f16+8:14462:x1874433522388352:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2180us (2849us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787599552.426960:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:0.0:1787599552.431933:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599552.432950:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522388608 00000100:00100000:3.0:1787599552.432967:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522388608 00000100:00100000:3.0:1787599552.433063:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:3.0:1787599552.433077:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6629fd8-f639-4f53-ba01-94b418582f16+8:14462:x1874433522388608:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:3.0:1787599552.433153:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599552.433212:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183a9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07667 expref: 8 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.433238:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f6c70382100) 00010000:00010000:3.0:1787599552.433257:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787599552.433290:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.433307:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.433318:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787599552.434325:0:14406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051571fbb reply state 000000001641a2a1 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599552.434342:0:14406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787599552.434357:0:14406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787599552.434497:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6629fd8-f639-4f53-ba01-94b418582f16+9:14462:x1874433522388608:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 1419us (2576us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787599552.434507:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00010000:00010000:2.0:1787599552.440680:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.440703:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.440713:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.440720:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24c200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599552.440726:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.440734:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.440755:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f6c5b122100) 00010000:00010000:2.0:1787599552.440775:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787599552.440782:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.440789:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c200/0xa46cbc6741183ab3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599552.441256:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599552.442097:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522388864 00000100:00100000:2.0:1787599552.442111:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522388864 00000100:00100000:2.0:1787599552.442203:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:2.0:1787599552.442224:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6629fd8-f639-4f53-ba01-94b418582f16+8:14462:x1874433522388864:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1787599552.443241:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6629fd8-f639-4f53-ba01-94b418582f16+9:14462:x1874433522388864:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 1021us (1986us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787599552.443254:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:0.0:1787599552.450512:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599552.450894:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522389120 00000100:00100000:2.0:1787599552.450913:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522389120 00000100:00100000:2.0:1787599552.450999:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:2.0:1787599552.451014:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6629fd8-f639-4f53-ba01-94b418582f16+9:14462:x1874433522389120:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599552.451059:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599552.451088:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07675 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451263:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183ac1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451282:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451296:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451321:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183ac8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451330:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451337:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599552.451519:0:14407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787599552.451646:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451656:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183ac1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451663:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451669:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599552.451674:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451682:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183ac1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.451695:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:2.0:1787599552.451699:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599552.452511:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183ac1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452545:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183ac1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452569:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452576:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452582:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452587:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599552.452591:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452597:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452608:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f6c70382e00) 00010000:00010000:2.0:1787599552.452612:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599552.452616:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183ac8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452621:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183ac8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452681:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183aba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07675 expref: 11 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452704:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:2.0:1787599552.452706:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599552.452711:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07675 expref: 11 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.452910:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031800, rc 0) 00000100:00100000:2.0:1787599552.453012:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a6629fd8-f639-4f53-ba01-94b418582f16+10:14462:x1874433522389120:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2000us (2513us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787599552.453022:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:0.0:1787599552.457300:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599552.457416:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522389248 00000100:00100000:2.0:1787599552.457429:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522389248 00000100:00100000:2.0:1787599552.457507:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:2.0:1787599552.457519:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6629fd8-f639-4f53-ba01-94b418582f16+10:14462:x1874433522389248:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1787599552.457554:0:15521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599552.457584:0:15521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183ad6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0767c expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.457706:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.457724:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.457737:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599552.457799:0:15521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787599552.457820:0:15521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787599552.457849:0:15521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.457882:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183ad6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0767c expref: 12 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.457903:0:15521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0767c expref: 11 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.457914:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f6c70382d00) 00010000:00010000:2.0:1787599552.457917:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599552.457922:0:15521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031400, rc 0) 00000100:00100000:2.0:1787599552.457996:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a6629fd8-f639-4f53-ba01-94b418582f16+11:14462:x1874433522389248:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 479us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599552.458004:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:3.0:1787599552.462682:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599552.462919:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522389376 00000100:00100000:1.0:1787599552.462933:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522389376 00000100:00100000:1.0:1787599552.463021:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:1.0:1787599552.463044:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6629fd8-f639-4f53-ba01-94b418582f16+11:14462:x1874433522389376:12345-192.168.204.30@tcp:37:lfs.0 00000100:00100000:1.0:1787599552.473883:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a6629fd8-f639-4f53-ba01-94b418582f16+11:14462:x1874433522389376:12345-192.168.204.30@tcp:37:lfs.0 Request processed in 10770us (11136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599552.473971:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:3.0:1787599552.490068:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599552.490311:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522389632 00000100:00100000:2.0:1787599552.490324:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522389632 00000100:00100000:2.0:1787599552.490396:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1787599552.490409:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6b441c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6629fd8-f639-4f53-ba01-94b418582f16+11:14462:x1874433522389632:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1787599552.490931:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6b441c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a6629fd8-f639-4f53-ba01-94b418582f16+12:14462:x1874433522389632:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 523us (875us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787599552.490942:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1787599552.568143:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599552.568367:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522389760 00000100:00100000:0.0:1787599552.568382:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522389760 00000100:00100000:0.0:1787599552.568461:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:0.0:1787599552.568474:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+10:14468:x1874433522389760:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:0.0:1787599552.568503:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599552.568529:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18c00/0xa46cbc6741183ae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07683 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.568996:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19a00/0xa46cbc6741183aeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569015:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19a00/0xa46cbc6741183aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569040:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19a00/0xa46cbc6741183aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569060:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183af2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569068:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569077:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569254:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19000/0xa46cbc6741183af9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569263:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19000/0xa46cbc6741183af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569270:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19000/0xa46cbc6741183af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599552.569309:0:14405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787599552.569313:0:14405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599552.569366:0:14405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19000/0xa46cbc6741183af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569397:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19a00/0xa46cbc6741183aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569402:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19a00/0xa46cbc6741183aeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569424:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19a00/0xa46cbc6741183aeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569430:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e19a00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599552.569434:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19a00/0xa46cbc6741183aeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569441:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19a00/0xa46cbc6741183aeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569456:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:0.0:1787599552.569459:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599552.569463:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19a00/0xa46cbc6741183aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569469:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19a00/0xa46cbc6741183aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569483:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569488:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183af2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569493:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183af2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569505:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e18400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599552.569508:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183af2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569514:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183af2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569522:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f6c43a07b00) 00010000:00010000:0.0:1787599552.569525:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599552.569528:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183af2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569533:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183af2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.569572:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18c00/0xa46cbc6741183ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07683 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.570946:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19000/0xa46cbc6741183af9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07683 expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599552.570963:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f6c70382d00) 00010000:00010000:0.0:1787599552.570966:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787599552.570971:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75e19000, rc 0) 00000100:00100000:0.0:1787599552.571087:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+11:14468:x1874433522389760:12345-192.168.204.30@tcp:101:bash.0 Request processed in 2615us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599552.571098:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:0.0:1787599552.574055:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599552.574212:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522390016 00000100:00100000:2.0:1787599552.574226:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522390016 00000100:00100000:2.0:1787599552.574308:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:2.0:1787599552.574692:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+11:14468:x1874433522390016:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1787599552.574760:0:15521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599552.574794:0:15521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183b00 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0768a expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.574967:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.574987:0:15521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0767c expref: 11 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.574997:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.575056:0:15521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0767c expref: 11 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.575078:0:15521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0767c expref: 11 pid: 15521 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599552.575094:0:15521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75981c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15521:1874433543351168:192.168.204.30@tcp:104: 00000100:00100000:2.0:1787599552.575849:0:15521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b442a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599552.580477:0:15521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75981c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15521:1874433543351168:192.168.204.30@tcp:104: 00010000:00010000:2.0:1787599552.580525:0:15521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599552.585826:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599552.586945:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522390144 00000100:00100000:3.0:1787599552.586963:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522390144 00010000:00010000:3.0:1787599552.587015:0:14390:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0767c expref: 12 pid: 15521 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599552.587130:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1787599552.587142:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6629fd8-f639-4f53-ba01-94b418582f16+12:2358:x1874433522390144:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599552.587201:0:14390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599552.587211:0:14390:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0767c expref: 12 pid: 15521 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.587227:0:14390:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0767c expref: 12 pid: 15521 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.587256:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031400/0xa46cbc6741183add lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0767c expref: 12 pid: 15521 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.587314:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f6c70382d00) 00010000:00010000:3.0:1787599552.587321:0:14390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.587334:0:14390:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.587343:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.587381:0:14390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599552.587468:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6629fd8-f639-4f53-ba01-94b418582f16+11:2358:x1874433522390144:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 327us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599552.587476:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00010000:00010000:2.0:1787599552.587561:0:15521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.587570:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.587984:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.587997:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.588007:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.589322:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.589339:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.589350:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599552.589364:0:15521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787599552.589396:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.589404:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.589412:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.589418:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599552.589422:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.589443:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.589458:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f6c70382d00) 00010000:00010000:2.0:1787599552.589461:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599552.589466:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.589472:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b07 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599552.589486:0:15521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b45879ee reply state 000000003530b9e7 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599552.589496:0:15521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787599552.589536:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183b00 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0768a expref: 14 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.591453:0:15521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0768a expref: 13 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.591473:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599552.591477:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787599552.591481:0:15521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40030e00, rc 0) 00000100:00100000:2.0:1787599552.592208:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+14:14468:x1874433522390016:12345-192.168.204.30@tcp:101:bash.0 Request processed in 17882us (18173us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787599552.592222:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00010000:00010000:2.0:1787599552.601306:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.601352:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.601361:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.601368:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031600 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599552.601375:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.601384:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.601406:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f6c70382e00) 00010000:00010000:2.0:1787599552.601410:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599552.601415:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599552.601422:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b0e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599552.610285:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000040:00080000:2.0:1787599552.611508:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787599552.612406:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522390272 00000100:00100000:1.0:1787599552.612423:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522390272 00000100:00100000:1.0:1787599552.612507:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:1.0:1787599552.612520:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+13:14468:x1874433522390272:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:1.0:1787599552.612555:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599552.612580:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6e00/0xa46cbc6741183b23 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07691 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.613268:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.613287:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.613300:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599552.613350:0:14407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787599552.613355:0:14407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787599552.613380:0:14407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.613392:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.613421:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6e00/0xa46cbc6741183b23 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07691 expref: 15 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.613442:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07691 expref: 14 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.613468:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:1.0:1787599552.613471:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787599552.613475:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6b442c7200, rc 0) 00000100:00100000:1.0:1787599552.613561:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+14:14468:x1874433522390272:12345-192.168.204.30@tcp:101:bash.0 Request processed in 1044us (3290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599552.613570:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:0.0:1787599552.622580:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599552.623217:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522390528 00000100:00100000:1.0:1787599552.623232:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522390528 00000100:00100000:1.0:1787599552.623317:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:1.0:1787599552.623330:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+14:14468:x1874433522390528:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:1.0:1787599552.624004:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+15:14468:x1874433522390528:12345-192.168.204.30@tcp:35:bash.0 Request processed in 673us (1436us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787599552.624014:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:0.0:1787599552.772516:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599552.772628:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522390784 00000100:00100000:3.0:1787599552.772641:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522390784 00000100:00100000:3.0:1787599552.772721:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:3.0:1787599552.772733:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+15:14479:x1874433522390784:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599552.772765:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599552.772792:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e07698 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599552.773093:0:14406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787599552.773283:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07698 expref: 17 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.773966:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f6c50836600) 00010000:00010000:3.0:1787599552.773992:0:14406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599552.774000:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07698 expref: 17 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.774021:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d000, rc 0) 00000100:00100000:3.0:1787599552.774131:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+16:14479:x1874433522390784:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1399us (1631us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787599552.774141:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1787599552.783286:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599552.783677:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522391040 00000100:00100000:1.0:1787599552.783692:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522391040 00000100:00100000:1.0:1787599552.783769:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1787599552.783782:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+16:14479:x1874433522391040:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1787599552.784602:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+17:14479:x1874433522391040:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 816us (1325us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787599552.784613:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:0.0:1787599552.908536:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599552.909317:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522391296 00000100:00100000:3.0:1787599552.909334:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522391296 00000100:00100000:3.0:1787599552.909417:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:3.0:1787599552.909430:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+17:14482:x1874433522391296:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1787599552.909462:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599552.909489:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b3f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e0769f expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.909618:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183b46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.909645:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183b46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.909663:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183b46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599552.909676:0:14405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787599552.911047:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b3f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0769f expref: 20 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.911112:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183b46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0769f expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.911122:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599552.911125:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599552.911129:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d200, rc 0) 00000100:00100000:3.0:1787599552.911550:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+19:14482:x1874433522391296:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 2120us (3028us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787599552.911562:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:0.0:1787599552.926071:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599552.926213:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599552.926454:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522391552 00000100:00100000:1.0:1787599552.926468:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522391552 00000100:00100000:1.0:1787599552.926558:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1787599552.926572:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+19:2358:x1874433522391552:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599552.926615:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599552.926650:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d200/0xa46cbc6741183b46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0769f expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599552.926673:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:1.0:1787599552.926679:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599552.926751:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+18:2358:x1874433522391552:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 182us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599552.926758:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:3.0:1787599552.932796:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522391424 00000100:00100000:3.0:1787599552.932833:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522391424 00000100:00100000:3.0:1787599552.932930:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:3.0:1787599552.932942:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+18:14482:x1874433522391424:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:3.0:1787599552.933045:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b54 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.933066:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.933080:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.933115:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.933122:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b54 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.933150:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.933188:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599552.933194:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.933202:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b54 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.933215:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599552.933219:0:14406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599552.933224:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b54 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599552.933230:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b54 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599552.933341:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+18:14482:x1874433522391424:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 401us (7285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599552.933350:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:0.0:1787599552.937129:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599552.937537:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522391808 00000100:00100000:3.0:1787599552.937554:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522391808 00000100:00100000:3.0:1787599552.937629:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:3.0:1787599552.937642:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+18:14482:x1874433522391808:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:3.0:1787599552.938367:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+19:14482:x1874433522391808:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 653us (1178us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787599552.938379:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00010000:00010000:2.0:1787599553.189441:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599553.361500:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599553.361944:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522392064 00000100:00100000:2.0:1787599553.361958:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522392064 00000100:00100000:2.0:1787599553.362049:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1787599553.362064:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+19:14513:x1874433522392064:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:2.0:1787599553.362097:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599553.362125:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b5b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076a6 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.362340:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183b62 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.362359:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183b62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.362373:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183b62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599553.362387:0:14407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787599553.362601:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b5b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076a6 expref: 22 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.362624:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183b62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076a6 expref: 21 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.362636:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599553.362640:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787599553.362644:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031800, rc 0) 00000100:00100000:2.0:1787599553.362721:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+21:14513:x1874433522392064:12345-192.168.204.30@tcp:101:cat.0 Request processed in 659us (1234us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787599553.362729:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:0.0:1787599553.368046:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.368209:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522392320 00000100:00100000:1.0:1787599553.368223:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522392320 00000100:00100000:1.0:1787599553.368299:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1787599553.368312:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+21:14513:x1874433522392320:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:1.0:1787599553.368762:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+22:14513:x1874433522392320:12345-192.168.204.30@tcp:35:cat.0 Request processed in 449us (728us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787599553.368770:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:0.0:1787599553.374417:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.374635:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522392448 00000100:00100000:3.0:1787599553.374650:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522392448 00000100:00100000:3.0:1787599553.374734:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:3.0:1787599553.374746:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+22:2358:x1874433522392448:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599553.374767:0:14390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599553.374804:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183b62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076a6 expref: 22 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.374842:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599553.374849:0:14390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599553.374924:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+21:2358:x1874433522392448:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 179us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599553.374933:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:0.0:1787599553.464294:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.464971:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522392704 00000100:00100000:3.0:1787599553.464986:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522392704 00000100:00100000:3.0:1787599553.465082:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:3.0:1787599553.465095:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+21:14519:x1874433522392704:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:3.0:1787599553.465133:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599553.465224:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b70 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076ad expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.465367:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.465387:0:14406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0768a expref: 22 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.465396:0:14406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07691 expref: 22 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.465430:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.465475:0:14406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07691 expref: 22 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.465492:0:14406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07691 expref: 22 pid: 14407 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599553.465511:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14406:1874433543351296:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599553.465647:0:14406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0768a expref: 22 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.465657:0:14406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0768a expref: 22 pid: 15521 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599553.465666:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14406:1874433543351424:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599553.465691:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c50f73480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599553.469239:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.469308:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599553.469407:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522392832 00000100:00100000:2.0:1787599553.469422:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522392832 00010000:00010000:2.0:1787599553.469480:0:14391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07691 expref: 23 pid: 14407 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599553.469527:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522392960 00000100:00100000:2.0:1787599553.469545:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522392960 00010000:00010000:2.0:1787599553.469560:0:14391:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0768a expref: 24 pid: 15521 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599553.469586:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:2.0:1787599553.469597:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fcbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+24:2359:x1874433522392832:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599553.469617:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599553.469626:0:14391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07691 expref: 24 pid: 14407 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.469640:0:14391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07691 expref: 24 pid: 14407 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.469669:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599553.469675:0:14391:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.469685:0:14391:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.469692:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599553.469760:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fcbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+24:2359:x1874433522392832:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 164us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599553.469770:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:2.0:1787599553.469852:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:2.0:1787599553.469858:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+23:2359:x1874433522392960:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599553.469867:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599553.469872:0:14391:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0768a expref: 23 pid: 15521 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.470065:0:14391:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0768a expref: 23 pid: 15521 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.470083:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599553.470087:0:14391:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.470095:0:14391:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.470104:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.470129:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599553.470152:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+23:2359:x1874433522392960:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 293us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599553.470207:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00010000:00010000:3.0:1787599553.471741:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7200/0xa46cbc6741183b2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e07691 expref: 22 pid: 14407 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599553.471772:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14406:1874433543351296:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599553.471790:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183b15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e0768a expref: 21 pid: 15521 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599553.471847:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14406:1874433543351424:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599553.471877:0:14406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.471887:0:14406:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.471904:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599553.471934:0:14406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787599553.472241:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b70 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ad expref: 22 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.472259:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d400/0xa46cbc6741183b77 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ad expref: 21 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.472268:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599553.472272:0:14406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787599553.472275:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24d400, rc 0) 00000100:00100000:3.0:1787599553.472356:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+21:14519:x1874433522392704:12345-192.168.204.30@tcp:101:dd.0 Request processed in 7264us (8078us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787599553.472366:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:0.0:1787599553.490346:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.490662:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522393216 00000100:00100000:3.0:1787599553.490678:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522393216 00000100:00100000:3.0:1787599553.490765:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:3.0:1787599553.490779:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+21:14519:x1874433522393216:12345-192.168.204.30@tcp:36:dd.0 00010000:00010000:3.0:1787599553.491269:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.491305:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.491320:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599553.491383:0:14405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787599553.491428:0:14405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002135e42e reply state 000000005f7d29a8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599553.491438:0:14405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599553.494970:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14519:x1874433522393216:12345-192.168.204.30@tcp:36:dd.0 Request processed in 4174us (4622us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787599553.494988:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000020:00080000:3.0:1787599553.494999:0:14405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787599553.502763:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.502800:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.502809:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.502822:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24d000 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599553.502829:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.502866:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.502899:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599553.502902:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599553.502907:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.502914:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24d000/0xa46cbc6741183b85 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599553.504676:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599553.506378:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522393344 00000100:00100000:2.0:1787599553.506399:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522393344 00000100:00100000:2.0:1787599553.506499:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:2.0:1787599553.506513:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+23:14519:x1874433522393344:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:2.0:1787599553.506547:0:15521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599553.506575:0:15521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b8c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076b4 expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.506653:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076b4 expref: 24 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.506672:0:15521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076b4 expref: 24 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.506696:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:2.0:1787599553.506700:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787599553.506704:0:15521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c40031600, rc 0) 00000100:00100000:2.0:1787599553.507538:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14519:x1874433522393344:12345-192.168.204.30@tcp:101:dd.0 Request processed in 1021us (2869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599553.507550:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:0.0:1787599553.540442:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.540900:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522393600 00000100:00100000:3.0:1787599553.540916:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522393600 00000100:00100000:3.0:1787599553.541019:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:3.0:1787599553.541032:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14519:x1874433522393600:12345-192.168.204.30@tcp:103:dd.0 00010000:00010000:3.0:1787599553.541052:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599553.541086:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031600/0xa46cbc6741183b8c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076b4 expref: 24 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.541111:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599553.541118:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599553.541235:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+23:14519:x1874433522393600:12345-192.168.204.30@tcp:103:dd.0 Request processed in 205us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599553.541265:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:1.0:1787599553.559529:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599553.560425:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522393728 00000100:00100000:2.0:1787599553.560440:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522393728 00000100:00100000:2.0:1787599553.560527:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:2.0:1787599553.560553:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+23:14519:x1874433522393728:12345-192.168.204.30@tcp:58:dd.0 00010000:00010000:2.0:1787599553.560682:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.560702:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.560715:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599553.562199:0:14407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599553.562375:0:14407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787599553.562451:0:14407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787599553.562597:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+23:14519:x1874433522393728:12345-192.168.204.30@tcp:58:dd.0 Request processed in 2052us (3078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599553.562609:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:2.0:1787599553.566248:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.566369:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522393856 00000100:00100000:0.0:1787599553.566382:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522393856 00000100:00100000:0.0:1787599553.566461:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:0.0:1787599553.566473:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+23:14519:x1874433522393856:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:0.0:1787599553.566503:0:15521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599553.566529:0:15521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183b9a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076bb expref: -99 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.566626:0:15521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.566662:0:15521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183b9a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076bb expref: 24 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.566688:0:15521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.566707:0:15521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183b9a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076bb expref: 24 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.566726:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:0.0:1787599553.566730:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599553.566734:0:15521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183b9a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076bb expref: 24 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.566743:0:15521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75e18400, rc 0) 00000100:00100000:0.0:1787599553.567045:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14519:x1874433522393856:12345-192.168.204.30@tcp:101:dd.0 Request processed in 572us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599553.567054:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00000040:00080000:2.0:1787599553.638900:0:14440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787599553.638914:0:14440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599553.639002:0:14440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787599553.639023:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787599553.639270:0:14440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75980000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14440:1874433543351552:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787599553.639405:0:14440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c504a63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599553.645379:0:14440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75980000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14440:1874433543351552:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787599553.647698:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.650326:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522393984 00000100:00100000:0.0:1787599553.650350:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522393984 00000100:00100000:0.0:1787599553.650445:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:0.0:1787599553.650459:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14520:x1874433522393984:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787599553.650596:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14520:x1874433522393984:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 Request processed in 140us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599553.650628:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1787599553.654105:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.655657:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522394112 00000100:00100000:1.0:1787599553.655675:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522394112 00000100:00100000:1.0:1787599553.655779:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:1.0:1787599553.655793:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14520:x1874433522394112:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787599553.655848:0:14407:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787599553.656023:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14520:x1874433522394112:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 232us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599553.656055:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:1.0:1787599553.660054:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.661206:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522394240 00000100:00100000:0.0:1787599553.661225:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522394240 00000100:00100000:0.0:1787599553.661325:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:0.0:1787599553.661340:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14520:x1874433522394240:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787599553.661437:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183ba1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.661459:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.661476:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663375:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183ba8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663402:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663415:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663454:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663462:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663468:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599553.663537:0:15521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787599553.663542:0:15521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787599553.663556:0:15521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663567:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663573:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183ba1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663580:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663586:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e19200 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599553.663592:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663601:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183ba1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663625:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c5b122e00) 00010000:00010000:0.0:1787599553.663629:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599553.663635:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183ba1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663642:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19200/0xa46cbc6741183ba1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663726:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663744:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663750:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663755:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e18e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599553.663759:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663765:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663773:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9f6c43a07b00) 00010000:00010000:0.0:1787599553.663775:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599553.663778:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183ba8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663784:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183ba8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663800:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663806:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663812:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663817:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e19800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599553.663898:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663907:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663917:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:0.0:1787599553.663919:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599553.663923:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.663929:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183baf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599553.664035:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14520:x1874433522394240:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 2695us (3991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599553.664045:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:0.0:1787599553.669043:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.669202:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522394496 00000100:00100000:1.0:1787599553.669215:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522394496 00000100:00100000:1.0:1787599553.669288:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:1.0:1787599553.669299:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+24:14520:x1874433522394496:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599553.669323:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599553.669345:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6a00/0xa46cbc6741183bb6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076c2 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.669457:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6400/0xa46cbc6741183bbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.669473:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6400/0xa46cbc6741183bbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.669483:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6400/0xa46cbc6741183bbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599553.669494:0:14407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787599553.669601:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6400/0xa46cbc6741183bbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.669619:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6400/0xa46cbc6741183bbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.669626:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6400/0xa46cbc6741183bbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.669632:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6400 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:1.0:1787599553.669652:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6400/0xa46cbc6741183bbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.669959:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6400/0xa46cbc6741183bbd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.669972:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:1.0:1787599553.669975:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787599553.669980:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6400/0xa46cbc6741183bbd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.669986:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6400/0xa46cbc6741183bbd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.670045:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6a00/0xa46cbc6741183bb6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076c2 expref: 26 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.670056:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f6c5b122e00) 00010000:00010000:1.0:1787599553.670059:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787599553.670063:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6a00/0xa46cbc6741183bb6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076c2 expref: 26 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.670073:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6b442c6a00, rc 0) 00000100:00100000:1.0:1787599553.670151:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+25:14520:x1874433522394496:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 853us (1116us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787599553.670190:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:2.0:1787599553.675800:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.675977:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522394624 00000100:00100000:3.0:1787599553.675988:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522394624 00000100:00100000:3.0:1787599553.676099:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:3.0:1787599553.676110:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+25:14520:x1874433522394624:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787599553.676147:0:14406:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787599553.676573:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+25:14520:x1874433522394624:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 464us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599553.676582:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:0.0:1787599553.692849:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.693131:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522394880 00000100:00100000:3.0:1787599553.693145:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522394880 00000100:00100000:3.0:1787599553.693563:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:3.0:1787599553.693577:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+25:14520:x1874433522394880:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599553.693607:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599553.693636:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183bcb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076c9 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787599553.696949:0:14405:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:3.0:1787599553.696965:0:14405:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787599553.700615:0:14405:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787599553.702392:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741183bd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.702421:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741183bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.702437:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741183bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.702542:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183bcb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076c9 expref: 28 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.702567:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741183bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076c9 expref: 27 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.702578:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c5b122000) 00010000:00010000:3.0:1787599553.702581:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599553.702586:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24c000, rc 0) 00000100:00100000:3.0:1787599553.702701:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+27:14520:x1874433522394880:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 9115us (9854us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787599553.702713:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:1.0:1787599553.711295:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.711534:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522395136 00000100:00100000:0.0:1787599553.711549:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522395136 00000100:00100000:0.0:1787599553.711924:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:0.0:1787599553.711941:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+27:14520:x1874433522395136:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599553.712082:0:15521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599553.712121:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24c000/0xa46cbc6741183bd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076c9 expref: 27 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.712148:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c5b122000) 00010000:00010000:0.0:1787599553.712338:0:15521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599553.712386:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183be0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.712405:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183be0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.712417:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183be0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.715534:0:15521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183be7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa994ace4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716051:0:15521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183be7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa994ace4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716067:0:15521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183be7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa994ace4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716181:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183be0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716189:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183be0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716196:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183be0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716202:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e19800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599553.716206:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183be0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716214:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183be0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716246:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f6c70382d00) 00010000:00010000:0.0:1787599553.716249:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599553.716253:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183be0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716259:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e19800/0xa46cbc6741183be0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716272:0:15521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183be7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa994ace4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716278:0:15521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183be7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa994ace4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716284:0:15521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183be7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa994ace4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716288:0:15521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e18e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:0.0:1787599553.716291:0:15521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183be7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa994ace4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716296:0:15521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183be7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa994ace4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716302:0:15521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa994ace4 (ffff9f6c43a07b00) 00010000:00010000:0.0:1787599553.716305:0:15521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599553.716307:0:15521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183be7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa994ace4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.716313:0:15521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18e00/0xa46cbc6741183be7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa994ace4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599553.716439:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+26:14520:x1874433522395136:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 4498us (5166us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599553.716449:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:2.0:1787599553.722470:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.722608:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522395264 00000100:00100000:1.0:1787599553.722620:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522395264 00000100:00100000:1.0:1787599553.722739:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:1.0:1787599553.722767:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+26:14520:x1874433522395264:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599553.722810:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599553.722845:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6800/0xa46cbc6741183bee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076d0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.722894:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7a00/0xa46cbc6741183bf5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.722911:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7a00/0xa46cbc6741183bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.722924:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7a00/0xa46cbc6741183bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.723065:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6800/0xa46cbc6741183bee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d0 expref: 28 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.723087:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c7a00/0xa46cbc6741183bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d0 expref: 27 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.723097:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:1.0:1787599553.723100:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787599553.723104:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6b442c7a00, rc 0) 00000100:00100000:1.0:1787599553.723231:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+27:14520:x1874433522395264:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 466us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599553.723238:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:0.0:1787599553.729285:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.729915:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522395520 00000100:00100000:3.0:1787599553.729932:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522395520 00000100:00100000:2.0:1787599553.731198:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:2.0:1787599553.731226:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+27:14520:x1874433522395520:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787599553.731321:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.731339:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.731351:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599553.733027:0:14406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787599553.733045:0:14406:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 511106887899ns, next at 512106884722ns, rc = 0 00000004:00010000:2.0:1787599553.733186:0:14406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cc97ba8 reply state 00000000c66dcdb2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599553.733199:0:14406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787599553.733323:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+29:14520:x1874433522395520:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 2108us (4044us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787599553.733332:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:0.0:1787599553.747953:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.748482:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522395648 00000100:00100000:3.0:1787599553.748497:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522395648 00000100:00100000:3.0:1787599553.748575:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:3.0:1787599553.748589:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+29:14520:x1874433522395648:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599553.748622:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599553.748652:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183c03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076d7 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.748742:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183c03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d7 expref: 30 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.748762:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183c03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d7 expref: 30 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.748821:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:3.0:1787599553.748825:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787599553.748831:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24ce00, rc 0) 00000100:00100000:3.0:1787599553.748916:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+30:14520:x1874433522395648:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 330us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599553.748923:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00010000:00010000:2.0:1787599553.754819:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.754845:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.754854:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.754886:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031800 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:2.0:1787599553.754892:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.754900:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.754924:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:2.0:1787599553.754927:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787599553.754933:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599553.754940:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031800/0xa46cbc6741183bfc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599553.758825:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.759390:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522395776 00000100:00100000:1.0:1787599553.759404:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522395776 00000100:00100000:1.0:1787599553.759503:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1787599553.759534:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2359:x1874433522395776:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787599553.760046:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2359:x1874433522395776:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 515us (1239us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787599553.760056:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00080000:3.0:1787599553.760584:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599553.781825:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.782194:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522396032 00000100:00100000:1.0:1787599553.782217:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522396032 00000100:00100000:1.0:1787599553.782298:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1787599553.782310:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+29:14520:x1874433522396032:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787599553.782629:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+30:14520:x1874433522396032:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 319us (815us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787599553.782637:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:2.0:1787599553.788609:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.788899:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522396288 00000100:00100000:0.0:1787599553.788913:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522396288 00000100:00100000:0.0:1787599553.788995:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:0.0:1787599553.789017:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+30:14520:x1874433522396288:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787599553.789222:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+30:14520:x1874433522396288:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 216us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599553.789230:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:0.0:1787599553.793150:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.793575:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522396416 00000100:00100000:3.0:1787599553.793589:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522396416 00000100:00100000:3.0:1787599553.793673:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:3.0:1787599553.793687:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+30:14520:x1874433522396416:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599553.793717:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599553.793746:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c0a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076de expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.793862:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24cc00/0xa46cbc6741183c11 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.793881:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24cc00/0xa46cbc6741183c11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.793895:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24cc00/0xa46cbc6741183c11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599553.793945:0:14405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787599553.793969:0:14405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24cc00/0xa46cbc6741183c11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.794037:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c0a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076de expref: 32 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.794063:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24cc00/0xa46cbc6741183c11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076de expref: 31 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.794073:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:3.0:1787599553.794076:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787599553.794081:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24cc00, rc 0) 00000100:00100000:3.0:1787599553.795261:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+31:14520:x1874433522396416:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 1566us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599553.795274:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:1.0:1787599553.800018:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.800102:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522396544 00000100:00100000:3.0:1787599553.800112:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522396544 00000100:00100000:3.0:1787599553.800222:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1787599553.800233:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c76704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+6:2358:x1874433522396544:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787599553.800252:0:15090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599553.800272:0:15090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076e5 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599553.800497:0:15090:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9ac0, blocks: 0x1 00010000:00010000:0.0:1787599553.800521:0:15090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1787599553.800526:0:15090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599553.800538:0:15090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076e5 expref: 7 pid: 15090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.800559:0:15090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076e5 expref: 7 pid: 15090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.800575:0:15090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c5b24dc00, rc 0) 00000100:00100000:0.0:1787599553.800655:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c76704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+7:2358:x1874433522396544:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 424us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599553.800663:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:2.0:1787599553.811937:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.811996:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522396800 00000100:00100000:1.0:1787599553.812018:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522396800 00000100:00100000:1.0:1787599553.812098:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:1.0:1787599553.812109:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+31:14520:x1874433522396800:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787599553.812272:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+31:14520:x1874433522396800:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 164us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599553.812281:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:2.0:1787599553.816974:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.817074:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522396928 00000100:00100000:1.0:1787599553.817085:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522396928 00000100:00100000:1.0:1787599553.817145:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:1.0:1787599553.817202:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+31:14520:x1874433522396928:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787599553.850827:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:0.0:1787599553.850842:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787599553.850859:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787599553.850879:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1787599553.851108:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+14:14520:x1874433522396928:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 33948us (34137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599553.851132:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:2.0:1787599553.851222:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543351680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787599553.851292:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599553.851818:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543351680 00000100:00100000:1.0:1787599553.851828:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543351680 00000100:00080000:3.0:1787599553.851895:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599553.851895:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599553.851909:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543351680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787599553.852077:0:15091:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787599553.852080:0:15091:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787599553.852083:0:15091:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787599553.852085:0:15091:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787599552 -> 1787599552 00002000:00010000:1.0:1787599553.852087:0:15091:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787599553.852137:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1874433543351680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 231us (845us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787599553.852144:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1787599553.852365:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f6c75fe5f80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787599553.852372:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543351680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787599553.860572:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.861582:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522397056 00000100:00100000:1.0:1787599553.861596:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522397056 00000100:00100000:1.0:1787599553.861685:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1787599553.861697:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+7:2358:x1874433522397056:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787599553.862740:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+7:2358:x1874433522397056:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 1036us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599553.862754:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:2.0:1787599553.882500:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.882690:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522397312 00000100:00100000:1.0:1787599553.882703:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522397312 00000100:00100000:1.0:1787599553.882795:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:1.0:1787599553.882808:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fe23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+14:14520:x1874433522397312:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787599553.882886:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599553.882939:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24cc00/0xa46cbc6741183c11 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076de expref: 14 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.882962:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:1.0:1787599553.882968:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787599553.883021:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.883038:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.883050:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787599553.883601:0:14406:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce41cdb7 reply state 0000000016e1eeb7 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599553.883614:0:14406:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787599553.884470:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fe23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+15:14520:x1874433522397312:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 1656us (1978us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787599553.884481:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00010000:00010000:3.0:1787599553.890146:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.890213:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.890251:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.890257:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6c00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599553.890263:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.890280:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.890302:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:3.0:1787599553.890306:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599553.890311:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.890318:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6b442c6c00/0xa46cbc6741183c1f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14406 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599553.891807:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.891902:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522397440 00000100:00100000:0.0:1787599553.891916:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522397440 00000100:00100000:0.0:1787599553.891992:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:0.0:1787599553.892013:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+7:14520:x1874433522397440:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599553.892037:0:15090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599553.892063:0:15090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa5342e6648e076ec expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.892101:0:15090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076e5 expref: 8 pid: 15090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.892111:0:15090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599553.892115:0:15090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599553.892121:0:15090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 8 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.892197:0:15090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076e5 expref: 8 pid: 15090 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.892250:0:15090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076e5 expref: 8 pid: 15090 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599553.892268:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15090:1874433543351808:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599553.892398:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4646f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787599553.896506:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15090:1874433543351808:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599553.896553:0:15090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 8 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.896579:0:15090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f6c75e19e00, rc 0) 00000100:00100000:0.0:1787599553.896649:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+8:14520:x1874433522397440:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 4646us (4864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599553.896659:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:3.0:1787599553.905246:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.906363:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522397568 00000100:00100000:0.0:1787599553.906389:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522397568 00010000:00010000:0.0:1787599553.906454:0:14392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076e5 expref: 8 pid: 15090 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599553.906510:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:0.0:1787599553.906521:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+8:2359:x1874433522397568:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599553.906541:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599553.906576:0:14392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076e5 expref: 8 pid: 15090 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.906617:0:14392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076e5 expref: 8 pid: 15090 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.906647:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076e5 expref: 8 pid: 15090 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.906669:0:14392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599553.906673:0:14392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599553.906681:0:14392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 7 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.906693:0:14392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 7 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.906745:0:14392:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 7 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599553.906764:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14392:1874433543351936:192.168.204.30@tcp:105: 00000100:00100000:1.0:1787599553.909938:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4646f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787599553.915482:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14392:1874433543351936:192.168.204.30@tcp:105: 00010000:00010000:1.0:1787599553.915518:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599553.915607:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+7:2359:x1874433522397568:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 9086us (10375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599553.915625:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1787599553.916031:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.916127:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522397696 00000100:00100000:0.0:1787599553.916140:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522397696 00000100:00100000:0.0:1787599553.916247:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:0.0:1787599553.916258:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+7:2358:x1874433522397696:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787599553.916540:0:15091:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787599553.916562:0:15091:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787599552 00002000:00010000:0.0:1787599553.916565:0:15091:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787599551 00002000:00010000:0.0:1787599553.916567:0:15091:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787599552 -> 1787599552 00002000:00010000:0.0:1787599553.916570:0:15091:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787599553.916642:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+8:2358:x1874433522397696:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 385us (637us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787599553.916650:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:3.0:1787599553.920777:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.921245:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522397824 00000100:00100000:0.0:1787599553.921259:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522397824 00000100:00100000:0.0:1787599553.921349:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1787599553.921361:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+8:2356:x1874433522397824:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787599553.921426:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.921452:0:15090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 8 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.921461:0:15090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599553.921466:0:15090:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787599553.921472:0:15090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.921517:0:15090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 8 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.921534:0:15090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 8 pid: 15090 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599553.921575:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15090:1874433543352064:192.168.204.30@tcp:104: 00000100:00100000:0.0:1787599553.921687:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c4646f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599553.927854:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599553.928100:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15090:1874433543352064:192.168.204.30@tcp:104: 00010000:00010000:0.0:1787599553.928134:0:15090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599553.929962:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522397952 00000100:00100000:1.0:1787599553.929979:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522397952 00010000:00010000:1.0:1787599553.930055:0:14390:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 9 pid: 15090 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599553.930229:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:1.0:1787599553.930243:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+9:2358:x1874433522397952:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599553.930265:0:14390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599553.930304:0:14390:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 9 pid: 15090 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.930321:0:14390:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 9 pid: 15090 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.930350:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4e89f5e/0xa46cbc6741183c26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076ec expref: 9 pid: 15090 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.930371:0:14390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599553.930376:0:14390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599553.930383:0:14390:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.930394:0:14390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.930435:0:14390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599553.930526:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+8:2358:x1874433522397952:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 286us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599553.930535:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00010000:00010000:0.0:1787599553.930608:0:15090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.930619:0:15090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.930648:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.930657:0:15090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.930666:0:15090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.930674:0:15090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e18c00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:0.0:1787599553.930680:0:15090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.930697:0:15090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.930710:0:15090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599553.930718:0:15090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ebfd3d1/0xa46cbc6741183c2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599553.930801:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+7:2356:x1874433522397824:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 9442us (10040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599553.930808:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:2.0:1787599553.938994:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599553.941800:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522398208 00000100:00100000:3.0:1787599553.941823:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522398208 00000100:00100000:3.0:1787599553.941911:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:3.0:1787599553.941924:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+14:14520:x1874433522398208:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787599553.942175:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ca00/0xa46cbc6741183c34 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.942219:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ca00/0xa46cbc6741183c34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.942233:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ca00/0xa46cbc6741183c34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.944410:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.944445:0:14405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183c03 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d7 expref: 15 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.944455:0:14405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.944510:0:14405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183c03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d7 expref: 15 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.944529:0:14405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183c03 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d7 expref: 15 pid: 14405 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599553.944548:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14405:1874433543352192:192.168.204.30@tcp:104: 00000100:00100000:3.0:1787599553.944681:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48de8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599553.970151:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.970369:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522398336 00000100:00100000:1.0:1787599553.970382:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522398336 00010000:00010000:1.0:1787599553.970439:0:14392:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183c03 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d7 expref: 16 pid: 14405 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599553.970510:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:1.0:1787599553.970523:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7605d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+16:2358:x1874433522398336:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599553.970542:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599553.970551:0:14392:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183c03 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d7 expref: 16 pid: 14405 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.970568:0:14392:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183c03 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d7 expref: 16 pid: 14405 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.970601:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:1.0:1787599553.970608:0:14392:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.970621:0:14392:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.970630:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599553.970653:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599553.970725:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+16:2358:x1874433522398336:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 205us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599553.970734:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00010000:00010000:3.0:1787599553.972346:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ce00/0xa46cbc6741183c03 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076d7 expref: 15 pid: 14405 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599553.975536:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14405:1874433543352192:192.168.204.30@tcp:104: 00010000:00010000:3.0:1787599553.975593:0:14405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.975631:0:14405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.975638:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599553.978332:0:14405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787599553.978908:0:14405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787599553.978960:0:14405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787599553.979120:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75de9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14405:1874433543352320:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787599553.979801:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599553.979865:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6b442a9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599553.980421:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543352320 00000100:00100000:1.0:1787599553.980443:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543352320 00000100:00100000:1.0:1787599553.980495:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599553.980504:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7609df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14405:x1874433543352320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787599553.980633:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7609df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14405:x1874433543352320:12345-0@lo:1000:mdt00_000.0 Request processed in 130us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599553.980640:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599553.983176:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75de9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14405:1874433543352320:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787599553.983940:0:14405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787599553.984053:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c7609fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14405:1874433543352448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787599553.984122:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599553.984188:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c5b3b9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599553.985741:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543352448 00000100:00100000:0.0:1787599553.985760:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543352448 00000100:00100000:0.0:1787599553.985827:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599553.985844:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14405:x1874433543352448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787599553.987280:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14405:x1874433543352448:12345-0@lo:1000:mdt00_000.0 Request processed in 1435us (3155us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787599553.987293:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599553.987768:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c7609fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14405:1874433543352448:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787599553.988973:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.988985:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.988992:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.988997:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24dc00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599553.989011:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.989019:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.989035:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:3.0:1787599553.989039:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787599553.989043:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.989171:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c3b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.989233:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.989240:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.989246:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.989251:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031e00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599553.989254:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.989261:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.990636:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599553.990644:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787599553.990652:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183b9a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076bb expref: 18 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.990664:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183b9a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076bb expref: 18 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.990673:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183b9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076bb expref: 18 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.992447:0:14405:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c75e18400/0xa46cbc6741183b9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xa5342e6648e076bb expref: 18 pid: 15521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599553.992492:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c75fe4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14405:1874433543352576:192.168.204.30@tcp:105: 00000100:00100000:3.0:1787599553.993323:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f6c48de8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599553.998233:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1787599553.998672:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522398464 00000100:00100000:1.0:1787599553.998695:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522398464 00000100:00100000:1.0:1787599553.998763:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1787599553.998898:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c7502f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+19:14519:x1874433522398464:12345-192.168.204.30@tcp:49:dd.0 00000100:00100000:1.0:1787599553.999073:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7502f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+19:14519:x1874433522398464:12345-192.168.204.30@tcp:49:dd.0 Request processed in 300us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599553.999082:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:3.0:1787599553.999831:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c75fe4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14405:1874433543352576:192.168.204.30@tcp:105: 00010000:00010000:3.0:1787599553.999856:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.999867:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40031e00/0xa46cbc6741183b93 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.999898:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c42 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.999911:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c42 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.999921:0:14405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c42 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.999931:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c42 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.999936:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c42 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.999943:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c42 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599553.999948:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24dc00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599554.001057:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c42 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.001082:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c42 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.001095:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599554.001098:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599554.001102:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c42 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.001107:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24dc00/0xa46cbc6741183c42 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.001120:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ca00/0xa46cbc6741183c34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.001125:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ca00/0xa46cbc6741183c34 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.001131:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ca00/0xa46cbc6741183c34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.001136:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24ca00 already unused, calling callback (ffffffffc1f184f0) 00010000:00010000:3.0:1787599554.001139:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ca00/0xa46cbc6741183c34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.001145:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ca00/0xa46cbc6741183c34 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.001153:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f6c70382500) 00010000:00010000:3.0:1787599554.001183:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599554.001186:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ca00/0xa46cbc6741183c34 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.001204:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c5b24ca00/0xa46cbc6741183c34 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599554.001918:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c7605d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+18:14520:x1874433522398208:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 59992us (62937us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787599554.001930:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000020:00080000:3.0:1787599554.001935:0:14405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787599554.004525:0:14440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787599554.004535:0:14440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599554.004582:0:14440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787599554.004588:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787599554.009403:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599554.009693:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522398720 00000100:00100000:3.0:1787599554.009704:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522398720 00000100:00100000:3.0:1787599554.009788:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:3.0:1787599554.009800:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+18:14520:x1874433522398720:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00080000:0.0:1787599554.011847:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1787599554.012462:0:14408:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787599554.013048:0:14408:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787599554.013110:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599554.013127:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599554.013138:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599554.013147:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599554.013154:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599554.013221:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599554.013294:0:14408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787599554.013404:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+20:14520:x1874433522398720:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 3604us (4008us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787599554.013414:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000020:00080000:2.0:1787599554.013419:0:14408:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787599554.015477:0:14393:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599554.015490:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.015499:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40030e00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599554.015503:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.015512:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.015528:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f6c50836f00) 00010000:00010000:1.0:1787599554.015531:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787599554.015535:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.015667:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f6c40030e00/0xa46cbc6741183c49 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.015776:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599554.015841:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599554.015844:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599554.081726:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599554.081753:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c76705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543352704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599554.081846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599554.082038:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543352704 00000100:00100000:1.0:1787599554.082048:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543352704 00000100:00100000:1.0:1787599554.082121:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599554.082132:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543352704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599554.082192:0:15093:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787599554.082413:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599554.082524:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543352704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 393us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599554.082533:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599554.082730:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c76705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543352704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599554.184579:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599554.184620:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599554.184811:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599554.192793:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1787599554.194048:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522398976 00000100:00100000:0.0:1787599554.194082:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522398976 00000100:00100000:0.0:1787599554.194245:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522398848 00000100:00100000:0.0:1787599554.194249:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522398848 00000100:00100000:0.0:1787599554.194267:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522399104 00000100:00100000:0.0:1787599554.194269:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522399104 00000100:00100000:1.0:1787599554.194366:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1787599554.194380:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+9:2359:x1874433522398976:12345-192.168.204.30@tcp:4:dd.0 00002000:00010000:1.0:1787599554.194430:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8c9ac0, atime: 0x6a8c9abf, ctime: 0x6a8c9ac0, blocks: 0x1 00010000:00010000:1.0:1787599554.194440:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183c50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.194457:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=511s v=(0 0) 00010000:00010000:1.0:1787599554.194462:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1787599554.194469:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:1.0:1787599554.194470:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599554.194483:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:1.0:1787599554.194487:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599554.194502:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599554.194523:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599554.194617:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522399232 00000100:00100000:3.0:1787599554.194622:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522399232 00000100:00100000:3.0:1787599554.194647:0:15096:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787599554.194654:0:15096:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787599554.194825:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522399360 00000100:00100000:3.0:1787599554.194828:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522399360 00000100:00100000:3.0:1787599554.194844:0:15096:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787599554.194848:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522399488 00000100:00100000:3.0:1787599554.194850:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522399488 00000100:00100000:3.0:1787599554.194859:0:15096:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787599554.194862:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522399616 00000100:00100000:3.0:1787599554.194863:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522399616 00000100:00100000:3.0:1787599554.194871:0:15096:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787599554.194874:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522399744 00000100:00100000:3.0:1787599554.194876:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522399744 00000100:00100000:0.0:1787599554.195291:0:15095:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787599554.195520:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1787599554.195530:0:16631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+14:2359:x1874433522398848:12345-192.168.204.30@tcp:4:dd.0 00010000:00010000:2.0:1787599554.195623:0:16631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003be541f4/0xa46cbc6741183c57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599554.195636:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599554.195639:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599554.195644:0:16631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003be541f4/0xa46cbc6741183c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599554.195655:0:16631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003be541f4/0xa46cbc6741183c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.209708:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787599554.338863:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1787599554.338880:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1787599554.338894:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:3.0:1787599554.352283:0:16631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1787599554.352291:0:16631:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787599552 -> 1787599553 00002000:00010000:3.0:1787599554.352308:0:16631:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787599552 -> 1787599553 00002000:00010000:3.0:1787599554.352311:0:16631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1787599554.352328:0:16631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003be541f4/0xa46cbc6741183c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.352355:0:16631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003be541f4/0xa46cbc6741183c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.352365:0:16631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003be541f4/0xa46cbc6741183c57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.352372:0:16631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c40031600 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:3.0:1787599554.352377:0:16631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003be541f4/0xa46cbc6741183c57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.352387:0:16631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003be541f4/0xa46cbc6741183c57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.352408:0:16631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003be541f4/0xa46cbc6741183c57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.352415:0:16631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003be541f4/0xa46cbc6741183c57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599554.352512:0:16631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+15:2359:x1874433522398848:12345-192.168.204.30@tcp:4:dd.0 Request processed in 156978us (167885us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787599554.352523:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:3.0:1787599554.352665:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:3.0:1787599554.352686:0:16631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+14:2358:x1874433522399104:12345-192.168.204.30@tcp:4:dd.0 00010000:00010000:3.0:1787599554.352720:0:16631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.352734:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599554.352738:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599554.352745:0:16631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599554.352758:0:16631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599554.413491:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1787599554.413792:0:15094:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00010000:00010000:1.0:1787599554.413808:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.413821:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183c50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.413830:0:15094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183c50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.413837:0:15094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7000 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599554.413842:0:15094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183c50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.413852:0:15094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183c50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.413872:0:15094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183c50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.413879:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8b20434/0xa46cbc6741183c50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599554.413975:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+14:2359:x1874433522398976:12345-192.168.204.30@tcp:4:dd.0 Request processed in 219593us (229400us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787599554.414014:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1787599554.414046:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:1.0:1787599554.414060:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+13:2358:x1874433522399232:12345-192.168.204.30@tcp:4:dd.0 00010000:00010000:1.0:1787599554.414090:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.414103:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599554.414108:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599554.414114:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.414125:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599554.493236:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1787599554.493531:0:16631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1787599554.493536:0:16631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1787599554.493565:0:16631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.493578:0:16631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.493587:0:16631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.493594:0:16631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c5b24dc00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599554.493609:0:16631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.493619:0:16631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.493638:0:16631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.493645:0:16631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b596fff8/0xa46cbc6741183c5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599554.493736:0:16631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+13:2358:x1874433522399104:12345-192.168.204.30@tcp:4:dd.0 Request processed in 141050us (308918us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787599554.493747:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:1.0:1787599554.498603:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:1.0:1787599554.498624:0:16631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+12:2358:x1874433522399360:12345-192.168.204.30@tcp:4:dd.0 00010000:00010000:1.0:1787599554.498665:0:16631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183c6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.498683:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599554.498688:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599554.498694:0:16631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.498708:0:16631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599554.565408:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1787599554.566205:0:15094:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1787599554.566212:0:15094:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1787599554.566228:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.566242:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.566250:0:15094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.566258:0:15094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7e00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599554.566262:0:15094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.566272:0:15094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.566292:0:15094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.566316:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599554.566405:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+12:2358:x1874433522399232:12345-192.168.204.30@tcp:4:dd.0 Request processed in 152343us (373616us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787599554.566427:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:1.0:1787599554.566466:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:1.0:1787599554.566478:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c466ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+11:2358:x1874433522399488:12345-192.168.204.30@tcp:4:dd.0 00010000:00010000:1.0:1787599554.566507:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc6741183c73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.566520:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599554.566525:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599554.566531:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc6741183c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.566543:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc6741183c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787599554.638879:0:16631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:1.0:1787599554.638888:0:16631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1787599554.638904:0:16631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.638916:0:16631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.638925:0:16631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.638932:0:16631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6c00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599554.638951:0:16631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.638961:0:16631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.638982:0:16631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183c6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.638998:0:16631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e966945/0xa46cbc6741183c6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599554.639084:0:16631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+13:2358:x1874433522399360:12345-192.168.204.30@tcp:4:dd.0 Request processed in 140462us (444612us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787599554.639093:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:1.0:1787599554.639125:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1787599554.639135:0:16631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+12:2358:x1874433522399616:12345-192.168.204.30@tcp:4:dd.0 00010000:00010000:1.0:1787599554.639195:0:16631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.639208:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787599554.639212:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599554.639217:0:16631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.639229:0:16631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787599554.647774:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:2.0:1787599554.689515:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1787599554.689916:0:15094:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1787599554.689922:0:15094:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1787599554.689936:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc6741183c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.689948:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc6741183c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.689956:0:15094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc6741183c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.689962:0:15094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c6400 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:0.0:1787599554.689967:0:15094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc6741183c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.689975:0:15094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc6741183c73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.690031:0:15094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc6741183c73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.690039:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c2feef3/0xa46cbc6741183c73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599554.690129:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c466ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+10:2358:x1874433522399488:12345-192.168.204.30@tcp:4:dd.0 Request processed in 123649us (495640us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787599554.690140:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:0.0:1787599554.690212:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:0.0:1787599554.690226:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+9:2358:x1874433522399744:12345-192.168.204.30@tcp:4:dd.0 00010000:00010000:0.0:1787599554.690266:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000072350ef/0xa46cbc6741183c81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.690279:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599554.690284:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599554.690289:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000072350ef/0xa46cbc6741183c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.690301:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000072350ef/0xa46cbc6741183c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599554.743767:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1787599554.751128:0:16631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1787599554.751140:0:16631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:1.0:1787599554.751169:0:16631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.751185:0:16631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.751474:0:16631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.751483:0:16631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6b442c7e00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:1.0:1787599554.751488:0:16631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.751498:0:16631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.751520:0:16631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599554.751529:0:16631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3d53a8d/0xa46cbc6741183c7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599554.751650:0:16631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:67b8f013-3a86-409b-99d3-ab128d48ac43+9:2358:x1874433522399616:12345-192.168.204.30@tcp:4:dd.0 Request processed in 112506us (557139us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787599554.751678:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00010000:00010000:0.0:1787599554.794116:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000072350ef/0xa46cbc6741183c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.794174:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000072350ef/0xa46cbc6741183c81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.794185:0:15094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000072350ef/0xa46cbc6741183c81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.794389:0:15094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f6c75e19a00 already unused, calling callback (ffffffffc14d9230) 00010000:00010000:0.0:1787599554.794395:0:15094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000072350ef/0xa46cbc6741183c81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.794405:0:15094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000072350ef/0xa46cbc6741183c81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.794426:0:15094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000072350ef/0xa46cbc6741183c81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599554.794434:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000072350ef/0xa46cbc6741183c81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599554.794617:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:67b8f013-3a86-409b-99d3-ab128d48ac43+7:2358:x1874433522399744:12345-192.168.204.30@tcp:4:dd.0 Request processed in 104324us (600021us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787599554.794629:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000001:00080000:1.0:1787599554.795943:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00000040:00080000:0.0:1787599555.042073:0:14440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787599555.042085:0:14440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599555.042116:0:14440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787599555.042134:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787599555.204220:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599555.204268:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599555.204301:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599555.204437:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599555.204462:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1787599555.204488:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1787599555.204543:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522399872 00000100:00100000:3.0:1787599555.204554:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522399872 00000100:00100000:3.0:1787599555.204613:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:3.0:1787599555.204625:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+13:2357:x1874433522399872:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599555.204710:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4860911-c292-444e-84ed-512edcaae1da+13:2357:x1874433522399872:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 87us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599555.204718:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:3.0:1787599555.204889:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522400000 00000100:00100000:3.0:1787599555.204894:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522400000 00000100:00100000:3.0:1787599555.204922:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522400256 00000100:00100000:3.0:1787599555.204925:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522400256 00000100:00100000:3.0:1787599555.204956:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:3.0:1787599555.204964:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+20:2357:x1874433522400000:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599555.205017:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67b8f013-3a86-409b-99d3-ab128d48ac43+20:2357:x1874433522400000:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 53us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599555.205037:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:3.0:1787599555.205050:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:3.0:1787599555.205057:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6629fd8-f639-4f53-ba01-94b418582f16+6:2357:x1874433522400256:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599555.205145:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a6629fd8-f639-4f53-ba01-94b418582f16+6:2357:x1874433522400256:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 87us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599555.205151:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00080000:3.0:1787599555.205195:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599555.214042:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522400128 00000100:00100000:0.0:1787599555.214060:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522400128 00000100:00100000:0.0:1787599555.214149:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522400384 00000100:00100000:0.0:1787599555.214183:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522400384 00000100:00100000:3.0:1787599555.214205:0:15090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433522400512 00000100:00100000:3.0:1787599555.214231:0:15090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433522400512 00000100:00100000:0.0:1787599555.214239:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:0.0:1787599555.214253:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2357:x1874433522400128:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599555.214374:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787599555.214388:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787599555.214567:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67b8f013-3a86-409b-99d3-ab128d48ac43+5:2357:x1874433522400128:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 312us (10293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599555.214570:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:3.0:1787599555.214586:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2357:x1874433522400384:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1787599555.214652:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2357:x1874433522400384:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 68us (10350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599555.214660:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:3.0:1787599555.214681:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787599555.214689:0:15090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:3.0:1787599555.214696:0:15090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2357:x1874433522400512:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1787599555.214720:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:3.0:1787599555.214741:0:15090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a6629fd8-f639-4f53-ba01-94b418582f16+5:2357:x1874433522400512:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 41us (10248us total) trans 0 rc 0/0 00000100:00080000:0.0:1787599555.215228:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599555.215234:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599555.217706:0:15090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00010000:00010000:2.0:1787599555.234050:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599556.259449:0:14393:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599556.646486:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543353088:0@lo:400:kworker.0 00000100:00100000:2.0:1787599556.646557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599556.646631:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599556.646638:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543353216:0@lo:400:kworker.0 00000100:00100000:2.0:1787599556.646664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599556.646881:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543353088 00000100:00100000:2.0:1787599556.646889:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543353088 00000100:00100000:3.0:1787599556.647088:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3301:1874433543352832:0@lo:400:kworker.0 00000100:00100000:3.0:1787599556.647128:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599556.647204:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543353344:0@lo:400:kworker.0 00000100:00100000:3.0:1787599556.647228:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599556.647246:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787599556.647253:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543352960:0@lo:400:kworker.0 00000100:00100000:3.0:1787599556.647276:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599556.659578:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543353216 00000100:00100000:0.0:1787599556.659596:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543353216 00000100:00100000:0.0:1787599556.659668:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543353344 00000100:00100000:0.0:1787599556.659671:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543353344 00000100:00100000:0.0:1787599556.659702:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787599556.659712:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543353216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599556.659809:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874433543353216:12345-0@lo:400:kworker.0 Request processed in 99us (13143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599556.659816:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787599556.659836:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599556.659843:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543353344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599556.659872:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874433543353344:12345-0@lo:400:kworker.0 Request processed in 30us (12643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599556.659878:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599556.659899:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543352832 00000100:00100000:0.0:1787599556.659902:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543352832 00000100:00100000:0.0:1787599556.659942:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787599556.659962:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74cf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3301:x1874433543352832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599556.659994:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74cf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ecb12f6-efb3-4b22-8787-68be26cc19d4+19:3301:x1874433543352832:12345-0@lo:400:kworker.0 Request processed in 47us (12865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599556.660002:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787599556.660127:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599556.660141:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c4fa0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543353600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599556.660200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599556.660259:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874433543353216:0@lo:400:kworker.0 00000100:00080000:0.0:1787599556.660280:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599556.660285:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599556.660295:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543353600 00000100:00100000:0.0:1787599556.660298:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543353600 00000100:00100000:0.0:1787599556.660326:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787599556.660333:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c4fa0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874433543353600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599556.660361:0:15093:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1787599556.660398:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c4fa0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874433543353600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599556.660403:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787599556.660426:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1787599556.660432:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f6c75fe5f80, transno 8589934595 00000004:00080000:0.0:1787599556.660441:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1787599556.660463:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c4fa0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874433543353600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599556.664796:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543352960 00000100:00100000:2.0:1787599556.664812:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543352960 00000100:00100000:2.0:1787599556.664896:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787599556.664909:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543353088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599556.665025:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874433543353088:12345-0@lo:400:kworker.0 Request processed in 119us (18467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599556.665033:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787599556.665052:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787599556.665059:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543352960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599556.665103:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874433543352960:12345-0@lo:400:kworker.0 Request processed in 45us (17826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599556.665109:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787599556.665195:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874433543353088:0@lo:400:kworker.0 00000100:00100000:3.0:1787599556.667787:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874433543352960:0@lo:400:kworker.0 00000100:00100000:3.0:1787599556.667803:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f6c74f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543353472:0@lo:400:kworker.0 00000100:00100000:3.0:1787599556.667861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599556.667898:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433543353472 00000100:00100000:3.0:1787599556.667904:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433543353472 00000100:00100000:3.0:1787599556.667965:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599556.667975:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f6c75fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543353472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599556.668022:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f6c75fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874433543353472:12345-0@lo:400:kworker.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599556.668028:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599556.668061:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874433543353472:0@lo:400:kworker.0 00000100:00100000:3.0:1787599556.668072:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2ecb12f6-efb3-4b22-8787-68be26cc19d4:3301:1874433543352832:0@lo:400:kworker.0 00000100:00100000:3.0:1787599556.668083:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f6c74f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874433543353344:0@lo:400:kworker.0 00000100:00080000:1.0:1787599556.669145:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599556.669170:0:14401:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787599556.749542:0:16672:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787599557.283810:0:14394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599558.306045:0:16516:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29790 lines, 29790 kept, 0 dropped, 0 bad.